AD-A181  981 


Research  Report  1436 


Implementation  of  a  Cognitive  Skills 
Training  Program  in  ROTC: 

The  Leadership  Enrichment  Program 


Paul  T.  Twohlg,  Douglas  L.  Rachford,  Joel  M.  Saveli,  and  Carlos  K.  Rigby 


-  r  ’  . 

Leadership  ahd  Management  Technical  Area 

Manpower  aridPersonnel  Research  Laboratory 


Approved  tor  public  rdtatr  distribution  unlimited. 


U.  S.  ARMY  RESEARCH  INSTITUTE 

FOR  THE  BEHAVIORAL  AND  SOCIAL  SCIENCES 

A  Field  Operating  Agency  under  the  Jurisdiction  of  the 
Deputy  Chief  of  Staff  for  Personnel 


EDGAR  M.  JOHNSON 
Technical  Director 


WM.  DARRYL  HENDERSON 

COL,  IN 

Commanding 


Technical  review  by 

Joan  Harman 
Fumiyo  Hunter 


BIST  Rl  QUTIQN  Primary  distribution  of  this  report  has  bean  made  by  ARI.  Please  address  corre¬ 
spondence  concerning  distribution  of  reports  to  U.S.  Army  Research- Institute  for  the  Behavioral 
and  Social  Sciences,  ATTN:  PERI-POT,  5001  Eisenhower  Ave  ,  Alexandria,  Virginia  22333-5600 

FINAL  DISPOSITION  This  report  may  be  destroyed  when  it  is  no  longer  needed  Plense  do  not 
return  it  to  the  U.S.  Army  Research  Institute  for  the  Behavioral  and  Social  Sciences. 

NC3TE:  The  findings  in  this  reporl  aie  not  to  be  construed  as  an  official  Department  of  the  A, my 
posmon,  unless  so  designated  by  other  authored  documents 


87  6  23  080 


UM.LAaoir  itD 


SECURITY  CLASSIFICATION  Of  THIS  PACE  fHTMW.  Dolo  Knfrmd) 


REPORT  DOCUMENTATION  PAGE 

READ  INSTRUCTIONS 

BEFORE  COMPLETING  FORM 

L  REPORT  NUMBER  J,  GOVT  ACCESSION  NO. 

ARI  Research  Report  1436 

3.  RECIPIENT'S  CATALOG  NUMBER 

4.  TITLE  (and  Subttil*) 

IMPLEMENTATION  OF  A  COGNITIVE  SKILLS  TRAINING 
PROGRAM  IN  ROTC :  THE  LEADERSHIP  ENRICHMENT 

PROGRAM 

S.  TYPE  OF  REPORT  b  PERIOD  COVEREO 

Final 

September  1983-July  1985 

(.  PERFORMING  ORG.  REPORT  NUMBER 

7.  AUTHORS 

Paul  T.  Twohig,  Douglas  L.  Rachford,  Joel  M. 

Saveli  and  Carlos  K.  Rigby 

S.  CONTRACT  OR  GRANT  NUMBER!*; 

S.  PERFORMING  ORGANIZATION  NAME  ANO  ADDRESS 

U.S.  Army  Research  Institute 

5001  Eisenhower  Avenue 

Alexandria,  ,VA  22333-5600 

10.  PROGRAM  ELEMENT.  PROJECT,  TASK 

AREA  0  PORK  UNIT  NUMBERS 

451  7700 

2Q162722A791 

H.  CONTROLLING  OFFICE  NAME  ANO  AODRESS 

U.S.  Array  Research  Institute 

5001  Eisenhower  Avenue 

Alexandria.  VA  22333-5600 

11.  REPORT  DATE 

March  1987 

11.  NUMBER  OF  PAOES 

94 

14.  MONITORING  AGENCY  NAME  •  ADDRESS^'  dttlnmit  /root  Controlling  Olll ct) 

IS.  SECURITY  CLASS,  (ol  Utlo  r.portj 

UNCLASSIFIED 

”iS«.  DECLASSIFICATION/ DOWNGRADING  ” 

__  SCHEDULE 

DISTRIBUTION  STATEMENT  (ol  Olio  K •port) 


Approved  for  public  release;  distribution  unlimited. 


I'l7.  DISTRIBUTION  STATEMENT  f»t  Uio  obtlttcl  ontond  In  Block  >0,  It  dllloront  from  RajwrtJ 


IS.  SUPPLEMENTARY  NOTH 


IS.  KI V  BOROS  (Contlnut  on  for* rot  aid*  It  naaauaary  mid  identity  by  block  nuotbar) 

Feuerstein  Leadership  Development 

Instrumental  Enrichment  ROTC  ' 

Thinking  Skills,  Field  Research 

Cognitive  Skills ^ 


I0»  AMTS  ACT'  (ftaSai  a»  nvoroo  aMo  If  nonhooy  aoB  IdbtUltr  by  Woe*  mjaibafJ 

Thin  report  describes  the  implementation  and  evaluation  of  the  Leadership 
Enrichment  Program  (LF.P),  an  application  of  the  Instrumental  Enrichment 
Program,  designed  to  increase  the  cognitive  performance  of  ROTC  cadets. 

Steps  to  ensure  a  strong  implementation  in  11  ROTC  programs  were  defined 
and  executed.  Although  the  project  was  cancelled  because  of  priorities 
after  1  year,  the  initial  results  indicated  positive  effects  on  cadet  cogni¬ 
tive  performance  and  acceptance  of  the  program  by  students  and  instructors. 


DO  ,ro~ 


i  jm!  n 


1473  comcm  or  i  mov  ts  is  omoute 


UNCLASSIFIED 

SECURITY  CLASSIFICATION  or  THIS  PAOE  (Bhon  Do «o  Knttrod) 


'"-‘■U'-tTf.  U  -  •  • 


Research  Report  1436 


Implementation  of  a  Cognitive  Skills 
Training  Program  in  ROTC: 

The  Leadership  Enrichment  Program 


Paul  T.  Twohlg,  Douglas  L.  Rachford,  Joel  M.  Saveli,  and  Carlos  K.  Rigby 


Leadership  and  Management  Technical  Area 
William  W.  Haythorn,  Chief 


Manpower  and  Personnel  Research  Laboratory 
Newell  K.  Eaton,  Director 


U.S.  ARMY  RESEARCH  INSTITUTE  FOR  THE  BEHAVIORAL  AND  SOCIAL  SCIENCES 

5001  Elsenhower  Avenue,  Alexandria,  Virginia  22333-5600 

Office,  Deputy  Chief  of  Staff  for  Personnel 
Department  of  the  Army 

March  1987 


Army  Proj«o<  Number  Manpower,  Paraonnal,  and  Training 

2Q162722A791 


Approved  for  public  release  distribution  unlimited. 
Ill 


* 


ARI  Research  Reports  and  Technical  Reports  are  intended  for  sponsors  of 
R&D  tasks  and  for  other  research  and  military  agencies.  Any  findings  ready 
for  implementation  at  the  time  of  publication  Bre  presented  in  the  last  part 
of  the  Brief.  Upon  completion  of  a  major  phase  of  the  task,  formal  recom¬ 
mendations  for  official  action  normally  are  conveyed  to  appropriate  military 
agencies  by  briefing  or  Disposition  Form. 


a 

iv 


t 


FOREWORD 


Leaders  have  always  needed  to  have  excellent  cognitive  skills,  and  this 
need  should  he  even  greater  on  the  modern  battlefield.  This  report  describes 
a  project  to  improve  the  cognitive  skills  of  ROTC  cadets — future  officers.  It 
provides  valuable  information  on  the  requirements  for  implementing  such  a  cogni¬ 
tive  skills  training  program  and  how  such  a  program  can  improve  the  performance 
of  Army  leaders. 


EDGAR  M.  JOHNSON 
Technical  Director 


IMPLEMENTATION  OF  A  COGNITIVE  SKILLS  TRAINING  PROGRAM  IN  ROTC: 
THE  LEADERSHIP  ENRICHMENT  PROGRAM 


EXECUTIVE  SUMMARY 


Requirement : 

To  improve  the  quality  of  Army  officers  by  improving  the  cognitive  and 
communicative  skills  of  ROTC  cadets. 


Procedure ; 

The  most  appropriate,  high-quality,  available  cognitive  skillB  training 
program  vas  identified — Instrumental  Enrichment  (il).  Then  a  program  was  de¬ 
signed  to  adapt  this  technology  to  ROTC  to  enhance  leadership  training,  par¬ 
ticularly  cognitive  and  communicative  skills.  There  were  11  experimental  and 
13  control  schools  (normal  Military  Science  (MS)  I  curriculum).  Getting  a 
strong  implementation  required  orienting  ROTC  personnel,  training  instructors, 
developing  a  special  curriculum  and  set  of  curriculum  materials  to  integrate 
cognitive  skills  training  and  the  MS  content,  developing  additional  curriculum 
materials  to  enhance  the  IE  materials  (e.g.,  special  writing  assignments),  and 
a  lessons-learned  and  planning  session  with  instructors  after  the  first  semes¬ 
ter.  Students  and  instructors  were  surveyed  and  interviewed  for  their  percep¬ 
tions  of  the  values  of  the  program.  Results  from  more  objective  measures  to 
evaluate  the  program  were  not  obtained  due  to  the  unexpected  early  cancella¬ 
tion  of  the  program  because  of  resource  limitations. 


Findings : 

The  results  of  the  surveys  and  interviews  indicated  that  75^  of  the  stu¬ 
dents  and  all  of  the  instructors  perceived  the  program  as  valuable  for  devel¬ 
oping  leaders.  Instructors  consistently  held  that  most  of  the  students  who 
did  not  respond  to  the  program  were  the  poorest  academi'  ally.  (Many  of  the 
schoolB  have  open  enrollment.)  Concrete  results  repor1  .'d  by  the  instructors 
included  improved  writing  and  facilitation  in  teaching  land  navigation.  In¬ 
structors  also  found  that  the  interactive  teaching  style  combined  with  obser¬ 
vations  of  the  students'  problem-solving  styles  gave  them  more  information 
by  which  to  identify  promising  cadets  than  more  traditional  teaching  methods. 
The  efforts  to  ensure  a  Btrong  implementation  were  successful  in  getting  the 
prescribed  implementation  in  all  11  ROTC  programs.  The  main  concern  of  in¬ 
structors  was  whether  there  were  enough  classroom  hours  available  in  the  MS 
curricula  to  do  Justice  to  the  IE  approach. 
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Utilization  of  Findings: 


Because  the  results  are  only  preliminary,  we  could  not  draw  a  firm  con¬ 
clusion  on  the  effectiveness  of  the  instrumental  Enrichment  Technique  for 
training  officers  in  ROTC.  However,  there  were  several  implications  of  thiB 
research  that  can  aid  in  improving  officer  training:  writing  assignments  can 
he  integrated  within  MS  content  and  add  to  the  learning  of  the  content;  mate¬ 
rials  analogous  to  some  of  the  IE  materials  might  aid  Land  Navigation  train¬ 
ing;  having  problem-solving  sessions  in  class  can  give  the  instructors  more 
insights  into  students'  abilities;  and  the  interactive  teaching  style  can 
increase  student  involvement.  In  addition,  the  actions  taken  to  implement 
this  program  can  guide  others  in  planning  interventions  within  ROTC. 
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IMPLEMENTATION  OP  A  COGNITIVE  SKILLS  TRAINING  PROGRAM 
IN  ROTCs  THE  LEADERSHIP  ENRICHMENT  PROGRAM 

INTRODUCTION 


Overall  Purpose 

. . . ^  This  report  describes  the  planning  and  implementation  of  a  program  to 

improve  the  general  cognitive  skills  of  Reserve  Offioer  Training  Corps  (ROTC) 
cadets.  This  program,  the  Leadership  Enrichment  program  (LEP),  was  largely  the 
application  of  the  Instrumental  Enriohment  (IE)  program  (Peuerstein,  1980)  and 
was  designed  to  take  several  years.  Eut  it  had  to  be  canceled  after  one  year 
due  to  a  shortage  of  resources  before  concrete  results  could  be  obtained. 

However,  there  were  valuable  lessons  learned  for  those  interested  in  one 
of  the  following:  (1  )  cognitive  skills  training,  (2)  field  research  on  train¬ 
ing  programs  in  the  Army,  and  (3)  conducting  intervention  programs  in  ROTC. 

This  report  both  documents  the  work  done  and  provides  information  for  those 
with  these  interests.  The  IE  program  is  described  in  some  detail  because  it  is 
an  important  program  in  itself  and  because  any  general  cognitive  skills  program 
would  probably  have  analogous  principles  and  procedures.  There  is  also  informa¬ 
tion  on  the  issues  one  has  to  deal  with  in  implementing  training  programs  and 
in  conducting  intervention  programs  in  ROTC. 

General  Background  '''"N 

It  is  dear  that  military  leadership  requires  effective  cognitive  Bkills 
whether  in  peacetime  or  during  war.  During  peacetime,  the  major  task  is  to  be 
prepared  for  war.  Preparedness  requires  many  activities  including  soldier 
training,  learning  and  adapting  new  technologies,  communicating,  planning, 
managing,  and  teaching.  Success  on  these  activities  requires  leaders  that  have 
a  high  level  of  cognitive  ability.  The  importance  of  thinking  ability  is  em¬ 
phasised  throughout  the  leadership  field  manual,  FM-22-100,  particularly  in  the 
sections  on  leadership  that  provide  direction  and  implementation. 

In  war  the  importance  of  cognitive  ability  is  even  more  obvious.  The 
FM-22-100  contains  a  description  of  Colonel  Joshua  Chamberlain's  heroic  per¬ 
formance  at  the  Battle  of  Gettysburgh.  Colonel  Chamberlain  showed  excellent 
cognitive  ability  in  conceptualizing  maneuvers  that  his  troopB  had  never  before 
carried  out  but  which  were  required  for  the  situation.  The  doctrine  for  Army 
21  identifies  even  more  severe  cognitive  demands  in  the  very  dynamic  future 
battlefield.  In  addition,  with  a  highly  distributed  battle,  Iowbt- ranked  lead¬ 
ers  will  be  making  decisions  that  previously  only  much  higher  ranked  officers 
have  made . 


One  way  to  obtain  quality  leaders  is  through  using  selection  standards, 
including  selection  on  cognitive  ability.  This  is  a  useful  approach.  But  it 
should  not  be  the  only  approach  because:  (1)  even  effective  thinkers  may  still 
benefit  from  training  In  cognitive  skills;  and  (2)  the  pool  of  recruits  who 
meet  cognitive  and  other  standards  will  probably  he  too  small  for 
recruitment  goals  to  be  met. 

Specific  Background 

After  commissioning,  officers  go  to  an  Officer  Basic  Course  (OBC)  for 
further  training  and  evaluation.  Although  failure  rates  are  generally  low, 
losing  any  officers  at  this  point  represents  a  considerable  waste  of  resources. 
In  recent  years  the  Training  and  Doctrine  Command  (TRADOC)  has  become  concerned 
that  there  was  a  disproportionate  level  of  OBC  failures  for  the  students  com¬ 
missioned  through  certain  ROTC  programs.  Sines  the  students  from  many  of  these 
programs  came  from  economically  disadvantaged  backgrounds,  It  seemed  plausible 
that  their  full  abilities  had  not  been  developed.  The  Office  of  the  Deputy 
Chief  of  Staff  for  ROTC  (ODCSROTC)  requested  that  the  Army  Research  Institute 
identify  and  evaluate  a  program  to  train  cognitive  skills  within  an  ROTC  envi¬ 
ronment.  The  program  identified  was  Instrumental  Enrichment  which  was  devel¬ 
oped  by  Feuerstein  (Feuerstein,  1980).  In  a  pilot  study,  thiB  program  was 
embedded  in  the  MS  III  curriculum  of  12  ROTC  units  for  the  academic  year 
1982-1983  (Rigby,  Twohig,  Rachford,  Saveli,  1986.  But  there  was  little  time 
before  the  school  year  to  organize  the  program  optimally  to  ensure  a  good  im¬ 
plementation.  As  a  result,  the  implements tiou  quality  varied  greatly  across 
ROTC  programs.  Even  if  the  implementation  had  been  better,  one  year  was  too 
short  a  time  to  complete  all  of  the  training  tasks.  In  addition,  the  only 
criterion  measures  used  were  the  cadets'  performances  at  the  summer  camp  after 
MS  111.  A  more  precise  evaluation  would  include  more  direct  measures  of  cogni¬ 
tive  ability. 

The  results  showed  no  significant  effects  of  the  IE  program.  But  due  to 
the  implementation  and  measurement  problems  mentioned  above,  It  was  felt  that 
IE  had  not  been  fairly  tested.  The  rationale  for  choosing  IE  (discussed  fur¬ 
ther  below)  was  not  undercut  by  a  questionable  experiment.  In  addition,  there 
was  a  positive  subjective  response  from  most  of  the  students  and  ins  true trrs, 
particularly  from  units  that  had  implemented  the  program  well. 

The  positive  reactions  favorably  impressed  the  DCSROTC,  MG  Prlllaman,  and 
he  requested  that  ARI  develop  a  new  plan  for  implementing  IE  in  ROTC.  But  he 
stated  that  it  would  have  to  be  used  in  MS  1  and  MS  II  because  there  is  too 
much  pressure  on  the  Instructors  to  prepare  for  summer  camp  in  MS  III.  However, 
the  lessons  learned  in  the  MS  III  Intervention  guided  the  planning  for  the 
later  Intervention  (see  Rigby  et  al . ,  pages  18  and  19). 


Recently  the  goal  for  commissioning  has  gone  from  about  8000  to  1200  per  year. 
Preliminary  information  from  the  ROTC  Study  Group  indicates  that  there  is  no 
indication  that  the  higher  goal  will  bo  me e  in  coming  years. 
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Instrumental  Enrichment  (IE) 


Historical  Background 

Reuven  Feuerstein  (1980)  developed  Instrumental  Enrichment  in  Israel  to 
deal  with  the  poor  cognitive  performance  of  adolescents.  ?■  >,ae  adolescentB 
were  typically  from  non-western  cultures  and  were  having  i  i’iculty  fitting 
into  the  main  society.  Not  satisfied  with  standard,  static  assessment  devices 
(e.g.,  IQ  tests),  he  developed  a  dynamic  assessment  method,  the  Learning  Poten¬ 
tial  Assessment  Device,  LPAD  (Feuerstein,  1979)*  Subjects  would  progress 
through  a  series  of  tasks  of  generally  increasing  difficulty.  If  they  got 
stuck,  they  would  be  given  a  hint  or  set  of  hintB  in  increasing  degrees  of 
helpfulness.  The  assessment  of  learning  potential  was  based  more  on  how  a 
subject  used  past  learning  to  solve  new  tasks  than  on  the  percentage  of  correot 
solutions.  For  example,  a  suoject  might  get  several  problems  of  a  certain  type 
wrong,  but  then  learn  a  principle  that  would  solve  a  problem.  If  that  principle 
was  used  spontaneously  to  boIvs  a  series  of  problems,  that  would  be  evidence 
for  learning  potential.  Based  on  hiB  experience  with  the  LFAD  and  theoretioal 
considerations,  Feuerstein  developed  the  IE  training  program. 

Critical  Concepts 

There  are  several  critical  ideas  that  influenced  the  development  of  the  IE 
program.  Feuerstein’ s  most  fundamental  claim  iB  that  a  child's  learning  is 
enhanced  by  Mediated  Learning  Experiences  or  MLEs.  Piaget  (1954)  has  presented 
a  view  of  how  children  develop  their  abilities  to  organize  information  through 
interaction  with  the  environment.  Feuerstein  added  an  emphasis  on  the  impor¬ 
tance  of  interaction  with  other  people  for  cognitive  development,  somewhat 
along  the  lines  of  Vysgotsky  (1962). 

Adults  can  provide  MLEs  for  children  by  helping  the  children  improve  their 
abilities  to  conceptualize  the  world  around  them  and  to  solve  problems.  Suoh 
mediation  can  be  accomplished  iu  a  variety  of  wayB:  the  adult  might  model 
effective  thinking,  or  ask  questions  of  the  child,  or  explain  how  an  adult 
would  do  it,  or  set  up  learning  experiences,  etc.  In  any  case,  the  adult  would 
try  to  make  the  child  aware  of  the  process  of  thinking,  not  just  the  products 
of  thinking. 

Thus  Feuerstein' s  major  explanation  for  why  the  adolescents  he  dsalt  with 
showed  poor  cognitive  performance  was  that  the  adulte  who  raised  them  did  not 
provide  enough  MLBa.  He  recognized  however  that  the  source  of  the  problem  may 
not  always  lie  with  the  behavior  of  adults.  Children  may  have  trouble  having 
MLEs  because  of  their  own  deficits  nuoh  as  learning  disabilities.  Whatever  the 
source  or  sources  of  cognitive  deficits,  Feuerstein  argues  that  major  improve¬ 
ments  can  occur  through  providing  MLEs,  although  special  methods  might  be 
needed  for  those  with  physiologically  based  deficits. 

Feuerstein  has  developed  a  general  description  of  people  who  show  poor 
cognitive  ability.  Not  only  do  poor  performers  lack  certain  cognitive  skills, 
but  also  they  may  fail  to  apply  the  Bkills  that  they  are  capable  of  exhibiting 
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in  a  given  situation.  For  example,  even  though  they  may  use  categorization 
skills  in  one  situation,  they  may  fail  to  do  so  in  another  situation  where  the 
skills  are  appropriate.  Poor  performers  often  exhibit  what  Feuerstein  terms 
episodic  thinking.  That  is,  they  only  superficially  analyse  the  situation  they 
are  in  and  do  not  relate  it  to  past  or  anticipated  activities.  They  also  fail 
to  engage  in  hypothetical  thinking  to  improve  their  understanding  of  the  events 
they  enoounter.  When  poor  cognitive  performers  do  attempt  to  solve  a  problem, 
they  tend  to  do  so  impulsively  and  try  solution  methods  before  effective  prob¬ 
lem  analysis.  Other  researchers  have  also  found  that  poor  problem  solvers  tend 
to  have  an  Impulsive  rather  than  a  reflective  style  (Kagan,  1965). 

The  gist  of  Feuerstein' s  description  of  poor  performers  is  that  they  do 
not  gain  much  knowledge  or  skill  when  they  enoounter  information  from  the  envi¬ 
ronment  or  other  people.  Either  they  don't  have  the  required  oognitive  skills 
to  interpret  information  effectively  or  are  too  passive  to  apply  the  skills 
they  have  or,  if  they  apply  their  skills,  they  do  it  impulsively  and  ineffec¬ 
tively.  Feuerstein  states  that  they  laok  cognitive  modifiability  sinoe  they 
gain  so  little  from  encountering  information. 

Feuerstein,  of  course,  wants  to  reverse  these  characteristics  of  poor 
performers  through  the  IE  program.  He  wants  them  to  improve  their  skills  where 
they  are  deficient  and  to  make  them  more  actively  use  their  skills  in  problem 
solving  and  learning  (eliminate  episodio  thinking).  He  also  wants  them  to  move 
from  an  impulsive  to  a  roflective  oognitive  style.  Overall,  Feuerstein  hopes 
that  the  improvement  will  be  more  than  the  sum  of  its  parts,  with  the  parts 
being  the  individual  skills  trained.  HiB  goal  is  to  create  a  change  in  oogni¬ 
tive  structure  suoh  that  the  students  become  more  cognitively  modifiable. 

The  ooncept  of  cognitive  modifiability  is  critical  Binoe  people  who  im¬ 
prove  their  ability  to  learn  will  gain  in  knowledge  and  skills.  But  this  oog¬ 
nitive  enhancement,  in  turn,  should  increase  the  ability  to  learn  and  develop 
further.  Thus  there  is  a  "rich  gets  richer"  flavor  to  the  hypothesized  value 
of  becoming  cognitively  modifiable.  Feuerstein  terms  this  hypothesis,  the 
divergent  effects  hypothesis,  because  the  difference  in  performance  between 
those  who  are  cognitively  modifiable  and  those  who  are  not,  should  diverge  with 
time.  As  we  shall  see,  this  hypothesis  has  been  tested  by  Feuerstein  (i960). 

IE  Training  Materials 

To  develop  his  training  materials  and  techniques,  Feuerstein  (1980)  com¬ 
bined  his  overall  theoretical  perspective  and  his  experience  with  the  LPAD 
assessment  devioe.  To  help  oharaoterize  training  tasks,  he  developed  a  frame¬ 
work  he  termed  the  cognitive  map.  The  map  was  essentially  a  set  of  parameters 
or  dimensions  with  which  one  oould  oharaoterize  mental  acts,  particularly  those 
involved  in  doing  the  training  tasks.  One  of  the  most  important  dimensions  was 
that  of  phase  which  had  the  categories  of  input ,  elaboration  and  output.  These 
categories  correspond  to  the  typical  major  stages  in  information  processing 
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models  (e.g.,  Klatsky,  1980)  in  which  (l)  environmental  information  ie  taken  in 
(input)  (2)  then  it  ie  operated  on  by  various  cognitive  processes  (elaboration) 
and  (3)  a  response  is  organized  and  executed  (output),  Feuerstein  also  defined 
a  eet  of  cognitive  functions  in  which  poor  performers  tend  to  be  deficient.  The 
correction  of  these  deficits  can  be  used  as  goals  for  the  training  program.  In 
one  categorization  of  the  deficient  functions,  they  are  grouped  sb  to  whether 
they  fall  into  the  input,  elaboration  or  output  phases. 

The  set  of  training  materials  developed  have  the  following 
characteristics. 

*  14  booklets  (instruments)  of  paper  and  pencil  tasks. 

*  Each  Instrument  has  a  particular  cognitive  focus;  e.g.,  syllogisms 
(see  Table  1  for  some  of  the  skills  taught  in  IE). 

-  But  many  cognitive  skills  will  be  practiced  in  a  given  Instrument. 

*  Each  instrument  can  be  analysed  in  terms  of  the  cognitive  map. 

*  Usually  there  are  a  lot  of  small  problems,  many  per  page,  rather  than 
a  smell  number  of  more  extensive  problems. 

-  Thus  the  learner  ie  brought  along  in  relatively  Bmall  steps. 

*  The  problems  tend  to  increase  in  difficulty  as  one  proceeds  through  an 
instrument  usually  leading  to  a  set  of  mastery  problems  in  which  the 
student  needs  to  combine  previously  learned  skills, 

*  The  instruments  are  broken  into  sections,  each  with  its  own  training 
goals. 

-  These  sections  are  not  explicitly  labeled  in  the  instruments,  but 
they  are  known  to  the  teachers  through  additional  materials. 

*  Most  problems  are  in  diagrammatic,  not  verbal,  form. 

-  The  populations  that  Feuerstein  dealt  with  were  weak  in  using  the 
national  language. 

*  Task  instructions  are  often  implicit,  requiring  the  students  to  re¬ 
flect  on  what  is  required. 

*  The  14  instruments  fall  roughly  into  two  levels  of  difficulty. 

-  Some  instruments  are  viewed  as  prerequisites  of  others. 

*  Each  instrument  has  a  cover  page  with  a  symbol  for  that  instrument  and 
the  program  slogan  "Just  a  minute,  let  me  think". 
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Table  1 


Sample  Cognitive  Skills  Taught  Through  IE 
Comparing  Concepts  Systematically 
Categorizing/Organizing  Concepts 
Breaking  Sown  Components  of  a  Concept 
Interpreting  and  Writing  Instructions 
Spatial  Orientation 

Frames  of  Reference 

Manipulation  of  Images 
Time  Distance  Relations 

Logical  Thinking 

Social,  Behavioral  Analysis 
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IE  Training  Goals  and  Procedures 


Goals.  The  goals  of  IE  are  restated  and  ehmmarized  here  (Feuerstein, 

(19807* 

*  Hake  student#  more  cognitively  modifiable. 

*  Reduce  the  tendency  to  Indulge  in  episodic  thinking. 

*  Improve  performance  in  a  specifio  set  of  cognitive  functions. 

*  Change  oognitive  style;  examples i 

-  impulsive  to  more  reflective  style 

-  passive  to  more  aotive  thinking  style 

-  concrete  to  abstraot  thinking 

*  Improve  problem  solving  ability. 

*  Increase  insight  into  student's  cognitive  processes  and  thinking  in 
general. 

*  Make  effective  thinking  a  habit. 

-  Apply  it  in  everyday  activities. 

Classroom  Procedures.  The  training  prooess  can  perhaps  be  best  described 
by  outlining  a  model  classroom  aesnion. 

*  Analyse  the  IE  task  (teacher-led  group  student  activity). 

-  Look  over  instrument's  cover  and  discuss  and  hypothesise  as  a  group 
about  the  meaning  of  the  instrument's  symbol. 

-  Flip  through  the  pages  and  form  a  general  impression  of  the 
instrument  tasks  and  relations  between  types  of  tasks. 

-  Teacher  chooses  the  page  to  work  on,  and  olass  tries  to  discover 
what  the  task  is. 

-  Define  any  needed  vocabulary  terms  or  symbols. 

*  Students  first  attempt  the  IE  problems  on  one  or  two  pages  of  the 
instrument. 

-  Students  may  work  individually  or  in  teams. 

-  Teachers  will  look  over  work  and  may  give  hints  or  ask  questions, 

-  Teacher  may  model  how  one  does  a  task. 
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Discussion  of  IE  tasks. 


-  Students  may  present  their  efforts  to  class. 

-  Cognitive  principles,  strategies  are  discussed. 

-  Errors  are  analyzed. 

*  Cognitive  skills,  principles  are  applied. 

-  Skills  are  "bridged"  to  content  areas  (bridging  will  be  discussed 
below) . 

*  Teacher  summarizes  lessons  learned  and  restates  cognitive  principles 
and  skills  that  have  been  demonstrated. 

*  Note:  If  IE  tasks  were  assigned  for  homework,  they  may  also  be 
discussed  and  mediated  in  class. 

Training/Ooals  Match.  It  should  be  clear  how  the  training  process  is 
designed  to  meet  the  program  goals.  Some  examples  are: 

*  Insight  into  cognitive  processes  is  aided  by  a  student's  experience 
with  the  tasks,  his  or  her  verbalization  of  the  strategies  used,  and 
discussion  by  others. 

-  Both  the  processes  and  products  of  thinking  are  examined. 

*  Specific  cognitive  functions  are  practiced. 

*  The  process  of  hypothetical  thinking  is  emphasized  to  reduce  episodic 
thinking. 

*  Impulsivity  is  reduced  by  the  stress  on  careful  problem  analysis  and 
also  by  the  emphasis  on  self-awareness  of  performance. 

*  Problem  solving  is  practiced,  especially  the  problem  analysis  stage. 

*  The  IE  exercises  and  group  activity  are  designed  to  be  exciting  and 
encourage  an  active  thinking  style. 

*  Abstract  thinking  is  encouraged  by  the  extraction  of  cognitive 
principles  from  specific  exercises. 

-  e.g.,  teacher's  summarization,  bridging. 
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#  Applying  cognitive  principlea  ia  encouraged  through  bridging. 

Bridging  is  illustrated  in  Figure  1.  In  bridging,  the  IS  training  tasks 
and  teacher  mediation  are  used  to  practice  and  give  inBight  into  sons  cogni¬ 
tive  principles.  These  principles  are  then  applied  in  various  knowledge  do¬ 
mains,  e.g.,  MS  (military  science),  aaademio  topics,  personal  experience,  and 
leadership.  Bridging  can  be  merely  conceptual.  For  Instance,  one  can  Just 
talk  about  the  principles  involved  in  giving  clear  instructions  without  the 
student  actually  giving  instructions.  But  bridging  can  also  be  behavioral} 
e.g.,  you  apply  the  principles  while  actually  giving  instructions.  Bridging 
oan  work  in  both  directions.  For  instance,  while  a  teaoher  ia  presenting 
material  on  military  science,  such  as  land  navigation,  the  instructor  may  note 
how  it  is  necessary  to  apply  the  cognitive  principles  demonstrated  in  IE 
tasks. 

Empirical  Evaluation  of  IE 

A  comprehensive  review  of  the  research  evaluation  of  IE  is  presented  in  a 
separate  paper  by  the  current  research  team  (Saveli,  Raohford,  &  Twohig,  1984. 
But  a  few  remarks  will  be  made  here.  There  are  only  a  few  field  studies  that 
seem  to  fit  even  the  minimum  conditions  for  evaluation  of  the  IE  program.  But 
where  the  program  has  been  implemented  well  and  reliable  measures  used,  there 
has  been  evidence  for  an  improvement  in  cognitive  performance  (e.g., 
Feuerstein,  I960;  Branaford,  Stein,  Arbitman-Smith,  &  Vye,  in  press;  Ruiz, 
1989a,  1985b).  Typically,  there  is  no  evidence  for  statistically  significant 
results  until  well  into  the  program  (dose  to  100  hours  of  training).  In  two 
cases,  thore  has  been  evidenoe  for  the  divergent  effects  hypothesis; 

Feuerstein  (i960)  and  Ruiz  (1985a).  Feuerstein  found  that  students  who  had 
gone  through  an  IE  program  continued  to  improve  in  cognitive  performance, 
relative  to  control  groups  two  years  after  the  program  ended. 

The  overall  conclusion  is  that  the  results  on  the  effeotiveness  of  IE  are 
enoouraging,  but  the  jury  is  still  out  on  a  final  evaluation.  Bradley  (1985) 
in  particular  makes  the  case  for  oautior,.  An  important  caveat  is  that  most  of 
the  evidenoe  for  auocess  is  based  on  standard  paper-and-penoil  tests  (e.g., 
Primary  Mental  Abilities  Test),  particularly  scales  with  non-verbal  problems. 
It  should  be  noted  that  most  of  the  IE  training  tasks  emphasize  pictorial  over 
verbal  problems.  Thus,  the  question  arises  as  to  whether  there  is  transfer  of 
training  from  IE  to  tasks  that  are  different  from  the  IE  task.  The  ultimate 
goal  of  IE  must  be  to  improve  performance  in  "real  life"  activities  such  as 
aoademios,  job  performance,  etc.  But  such  wide  transfer  of  training  has  not 
been  demonstrated. 
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LEADERSHIP  ENRICHMENT  PROGRAM  (LEP) 


IE  Compared  to  Other  Programs 


Theoretical  Framework.  As  part  of  the  decision  to  ohooae  the  IE  program 
for  a  ROIC  field  study,  we  related  IE  to  current  theory  and  research  on  teach¬ 
ing  thinking,  including  other  programs.  Major  reviews  of  such  programs  in¬ 
clude:  Nickerson  (in  press)  and  Bransford,  Stein,  Arbitman-Smith,  and  Vye, 
(1985). 

It  will  be  helpful  to  discuss  various  approaches  to  teaching  thinking  in 
terms  of  a  cognitive  framework  ^Figure  2).  For  convenience,  we  might  divide 
cognitive  skills  Into  two  levels:  (l)  the  organisation  or  strategy  level  and 
(2)  the  implementing  level.  For  instance,  one  might  deoide  to  do  a  careful 
analysis  of  a  problem  (a  strategic  decision).  But  to  implement  the  analysis 
would  require  such  skills  as  logic,  categorization,  etc.  Some  implementing 
skills  were  shown  in  Table  1 . 

The  strategic  level  inherently  involves  choices,  and  further  choices  are 
made  depending  on  feedback  on  the  effectiveness  of  the  implementing  Bkills 
(Figure  2).  The  framework  presented  here  is  a  simple  one,  for  discussion 
purposes.  A  more  complete  system  of  cognitive  skills  is  presented  in  another 
paper  (Twohig,  in  press). 

We  may  relate  many  types  of  oonstruots  in  current  research  to  the  strate¬ 
gic  level.  Three  typos  are  shown  in  Figure  2.  The  olassio  problem-solving 
stageB  (problem  analysis,  solution  generation,  eto.)  are  steps  in  an  overall 
problem  solving  strategy.  One  deoides  how  much  effort  to  put  into  each  stage 
and  the  general  approach  to  use  in  dealing  with  eaoh  stage;  then  the  appropri¬ 
ate  implementing  skills  are  invoked. 

The  construct  of  Meta-Cognition  is  getting  a  great  deal  of  recent 
research  attention  (Brown,  Ambruster,  A  Baker,  1984).  Meta- cognition  means 
thinking  about  thinking  and  implies  self-awareness  of  one's  thought  processes. 
In  a  given  situation  one  might  be  aware  of  the  relevant  knowledge  one  has,  the 
understanding  one  has,  the  strategies  one  is  using,  and  how  well  one's  cogni- 
tive  processes  are  operating.  For  instance,  in  listening  to  a  lecture  one  can 
be  aware  of  one's  knowledge  of  the  topic,  how  well  one  is  understanding  the 
lecture,  the  strategies  one  is  using  to  understand,  how  well  one  is  carrying 
out  the  strategies,  etc.  Being  aware  of  one's  cognitive  processes  clearly  can 
provide  a  basis  for  strategic  choice,  especially  when  the  operating  strategies 
seem  to  be  unsuccessful. 

One  of  the  reasons  for  the  interest  in  meta- cognition  is  that  it  seems  to 
be  an  important  factor  in  training  cognitive  skills.  It  is  commonly  found 
that  enhancing  meta-oognition  increases  sucoess  in  improving  thinking  skills 
(Niokarson,  in  press).  For  instance  it  has  been  found  that  poor  readers  fail 
to  monitor  their  levels  of  understanding  of  what  they  are  reading  and  also 
fail  to  adjust  their  reading  strategies  to  improve  understanding  (Brown  et 
al.,  1984).  Training  that  teaches  poor  readers  to  be  more  self-aware  of  the 
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Figure  2 


reading  process  and  to  consciously  use  good  reading  strategies  has  led  to 
substantial  improvements  in  reading  performance.  It  haa  proved  more  difficult 
to  establish  the  value  of  meta- cognition  in  mors  complex  and  more  general 
programs  to  train  thinking  skills,  such  as  IE.  However,  we  would  expect' 
meta- cognition  to  be  important  in  general-skills  types  of  programs  based  on 
the  theoretical  framework  presented  above  and  extrapolation  from  research  on 
speoifio  skills  programs. 

Another  highly  studied  construct  related  to  the  strategic  level  is  that 
of  cognitive  style  (Goldstein  A  Blackman,  1978).  Cognitive  style  refers  to 
tralt-like  predispositions  to  deal  with  categories  of  information  and  ways  of 
organising  information.  For  instance,  one  might  prefer  verbal  over  non-verbal 
information  and  categorize  the  information  in  relatively  simple  or  complex 
ways.  There  are  many  dimensions  of  cognitive  style  that  have  been  studied 
such  as:  cognitive  complexity  (Streufert  A  Streufert,  1978),  Field  Depend¬ 
ence-Independence  (Witkin,  1950),  Impulsive-Reflective  thinking  (Kagan,  1965). 
The  concept  of  cognitive  style  clearly  belongs  at  the  strategic  level  sinoe  it 
involves  choices  in  information  processing. 

Based  on  the  presented  cognitive  framework,  we  would  want  a  general 
thinking  akilla  program  to  deal  with  thinking  at  the  strategic  level  and  give 
praatloe  in  a  wide  range  of  implementing  skills. 

Strong  Points  of  IE.  There  are  other  useful  frameworks  for  categorizing 
thinking  programs.  For  examples  see  Raymond  Niokerson  and  hi8  colleagues 
(Nickerson,  in  press;  Bruce  A  Smith,  1983;  Bransford  et  al.,  In  press). 

Though  many  of  the  available  programs  havs  excellent  features,  the  IE 
program  ia  probably  the  beat  current  program  overall  beoauee  it  is  strong  in 
eo  many  oritioal  dimensions.  This  is  particularly  true  if  the  target  group  is 
made  up  of  mostly  below-avarage  IQ  performers.  Some  oritioal  features  of  IE 
are: 

*  IE  purports  to  trains  skills  at  both  the  strategic  and  implementation 
levels  (Figure  2)  and  the  relations  between  skillB  at  these  levels. 

-  Table  1  lists  some  of  the  implementation  skills  trained  by  IE. 

*  IE  emphasizes  meta-cognition,  with  respect  to  both  a  person's  aware¬ 
ness  of  his  or  her  own  prooesses  and  of  thinking  processes  in  general 
(Bruoe  A  Smith,  1903). 

*  IE  works  on  changing  cognitive  styles,  particularly  the  refleo- 
tive-impuleive  dimension  that  has  been  found  critical  to  effective 
problem  solving. 

*  IE  works  on  problem  solving  in  general,  but  particularly  the  important 
problem  analysis  stage.  Research  has  shown  that  effective  analyais 
may  be  the  oritioal  difference  between  successful  and  unsuccessful 
problem  eolveru  (Bransford  et  al.,  1984). 
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*  IE  has  a  comprehensive  theoretical  perspective  that  guides  the 
approach  to  training. 

*  IE  is  designed  to  allow  for  many  hours  of  practice;  Given  the  known 
difficulty  in  obtaining  substantial  and  general  improvements  in  cogni¬ 
tive  skills,  one  can  expeot  it  will  require  many  hours  of  training  for 
successful  remediation,  particularly  for  low-level  performers.  It 
should  be  noted,  though,  that  this  feature  can  not  always  be  exploited 
because  of  time  constraints  in  a  particular  situation. 

*  The  IE  program  has  good  currieulum  support  materials  and  the  require¬ 
ment  of  quality  instructor  training.  The  program  is  not  just  dropped 
into  a  school  system. 

*  IE  focuses  on  a  basic  set  of  cognitive  processes  which  may  be  the  best 
approach  for  working  with  below-average  performers.  This  approach  may 
also  be  good  for  training  the  weak  areas  of  average  or  above-average 
performers. 

Issues  Concerning  IE.  For  some  purposes,  particularly  with  high  perform¬ 
ers,  you  may  not  be  aiming  for  remediation.  Instead  you  may  be  just  adding 
cognitive  skills  to  the  student's  repertoire.  In  such  oases  you  may  wish  a 
heuristics  (Hayes,  1981)  type  of  program  where  general  strategies  are  taught] 
e.g.,  backward  planning,  brainstorming,  decision  trees.  Such  programs  may  not 
need  as  many  hours  as  basic  remediation  programs  suoh  as  IE  to  teach  the 
skills. 

IE  trains  skills  to  obtain  a  general  Improvement  in  cognitive  performance 
rather  than  focusing  in  a  specific  knowledge  domain  such  as  mathematics  (e.g., 
Sohoefield,  1980).  Thus  IE  can  potentially  lead  to  a  general  Improvement  in 
problem-solving  and  learning  (improved  cognitive  modifiability).  It  should  be 
noted,  however,  that  some  researohera  question  the  goneral  skills  approaoh 
since  there  has  been  more  success  in  programs  that  teach  more  focused  skills 
(Glaser,  1984).  Glaser  proposes  that  perhaps  general  skills  should  be  devel¬ 
oped  out  of  learning  in  specific  knowledge  domains.  The  general/specific 
issue  is  very  complex  and  will  not  be  resolved  for  some  time.  To  deal  with 
this  issue,  the  IE  program  emphasizes  bridging  to  aid  the  application  of  gen¬ 
eral  principles  to  specific  applications.  Bridging  should  also  make  it  more 
likely  that  the  principles  will  be  applied  outside  of  the  classroom.  Some 
other  programs  do  not  emphasize  bridging  and,  therefore,  their  training  may 
only  bu  useful  for  tasks  like  the  trsinlng  tasks  (e.g.,  see  Bransford  et  al., 
1985,  comments  on  the  Whimbey  approach).  It  should  be  noted  that  some  IE 
implementations  did  not  seem  to  involve  much  bridging  (Saveli  et  al.,  1984. 

There  is  evidence  for  the  success  of  IE  (Ssvell  at  al.,  1984)  as 
discussad  above.  There  is  also  evidence  for  the  effectiveness  of  other  pro¬ 
grams;  e.g..  Project  Intelligence,  particularly  those  focused  on  s  particular 
domain.  But  IE  is  probably  tha  only  program  with  evidance  that  the  improved 
cognitive  performance  is  maintained  (or  even  increased)  for  years  after  the 
intervention,  e.g.,  Feuerstein  (1980). 


A  major  question  about  IE  is  to  what  extent  it  can  be  used  in  college 
populations,  as  was  done  in  the  ROTC  implementation,  since  it  was  developed 
for  poorly  performing  adolescents.  No  definitive  answer  oan  be  given  here, 
although  there  is  evidence  for  suooess  with  college  ege  students  (Ruiz, 

1985b).  Also,  our  previous  experience  with  IE  in  ROTC  (Rigby  et  al.,  1986) 
showed  that  some  of  the  highest  rated  cadets  felt  that  IE  had  improved  their 
performance. 

A  working  hypothesis  is  proposed  here.  IE  is  most  appropriate  for  popu¬ 
lations  analogous  to  that  for  which  IE  was  developed  in  Israel,  i.e.,  groups 
with  educational  disadvantages,  even  if  the  target  population  is  older  than 
the  Israeli  sample.  But  IE  may  be  of  some  help  to  people  of  a  wide  range  of 
ability.  Even  people  with  high  overall  IQ's  may  have  some  weak  specifio  skill 
areas.  Also,  most  people  probably  gain  from  training  in  strategic  thinking 
and  meta-cognition. 

The  skills  of  the  instructor  may  be  particularly  oritical  for  dealing 
with  a  group  of  people  who  vary  widely  in  cognitive  performance.  The  instruc¬ 
tor  can  raise  the  level  of  disouasion  to  any  level  or  series  of  levels  of 
abstraction,  through  bridging.  For  example,  one  can  bridge  from  the  orienta¬ 
tion  in  space  instruments  to  the  application  of  an  officer  mentally  taking  the 
oeroeptual  point  of  view  of  marching  troops}  e.g.,  what  is  in  front  of  them. 

At  a  more  abstract  level,  one  could  take  the  psychological  point  of  view  of 
someone  to  whom  you  were  writing.  The  ability  of  a  talented  instructor  to 
raise  the  disouasion  level  to  that  of  the  "students"  has  been  seen  in  the 
sessions  where  future  IE  instructors  were  trained.  Very  high  level  perform¬ 
ers,  including  Army  officers,  university  faculty  and  research  psychologists 
have  been  challenged  in  these  training  sessions. 

Overall,  then,. the  IE  program  seemed  to  be  a  particularly  good  choice  for 
the  defined  problem.  It  was  hoped  that  it  would  be  particularly  effective  for 
culturally  disadvantaged  students.  But  there  were  reasons  to  expect  positive 
effects  even  with  students  with  strong  educational  backgrounds.  Even  if  more 
effective  programs  are  developed  later,  they  will  likely  have  many  of  the  same 
features  as  the  IE  program. 

The  IE  program  has  been  discussed  in  the  abstract.  Before  describing  the 
implementation  of  IE  into  ROTC  (LEP),  the  critical  aspects  of  the  ROTC  system 
will  be  described. 


A  Partial  Description  of  the  ROTC  System 


ROTC  Organization 

The  ROTC  system  falls  within  the  US  Army  Training  and  Doctrine  Command 
(TRADOC).  The  ROTC  headquarters  is  the  ODCSROTC,  which  is  currently  commanded 
by  MG  John  G.  Prillaman.  Following  the  chain  of  commend,  the  system  is  di¬ 
vided  into  four  geographic  regions,  each  commanded  by  a  brigadier  general.  The 
regions  are  divided  into  areas  which  are  commanded  by  colonels  (06).  Each 
ROTC  unit  at  a  college  or  university  is  headed  by  the  Professor  of  Military 
Science  (PMS).  Typioelly  the  rank  of  the  PMS  is  lieutenant  colonel,  though 
quite  often  they  may  be  Majors.  At  large  units,  the  PMS  is  likely  to  be  e 


colonel  while  at  small  units  he  or  she  might  only  have  the  rank  of  captain. 
Considering  all  the  ROTC  instructors,  officer  ranks  range  from  captain  through 
colonel.  Host  units  also  have  non-commissioned  officers  as  instructors. 

General  Purpose  of  MS  1/MS  II 

The  courses  in  the  Military  Science  (MS)  sequence  are  labeled  MS  I,  MS 
II,  MS  III  and  MS  IV,  whioh  nominally  correspond  to  the  freshman,  sophomore, 
Junior,  and  senior  college  years,  respectively.  Students  voluntarily  enroll 
in  MS  I  and  MS  II  and  generally  have  not  made  any  commitment  to  the  Army, 
(There  may  be  some  students  on  a  four  year  ROTC  scholarship  that  have  some 
commitment  to  the  Army.)  If  a  student  decides  to  become  an  officer,  he  or  she 
contracts  with  the  Army  and  enters  two  further  years  of  training  in  MS  III  and 
MS  IV.  Students  with  prior  military  experience  can  bypass  MS  I  and  MS  II  and 
may  take  MS  III  courses  prior  to  the  Junior  year.  The  latter  group  represents 
a  significant  portion  of  those  who  are  commissioned  through  ROTC. 

With  this  structure,  the  major  goals  of  MS  I  and  MS  II  are:  (1)  to  iden¬ 
tify  and  recruit  good  officer  candidates;  and  (2)  to  present  introductory 
education  and  training  in  military  science  content  and  the  theory  and  practice 
of  leadership. 

Influences  on  the  MS  I/MS  II  Curriculum 

As  mentioned  earlier,  each  ROTC  unit  is  headed  by  a  Professor  of  Military 
Science  (PMS).  The  PMS  has  significant  latitude  in  designing  the  MS  program. 
But  there  are  also  significant  constraints  on  his  or  her  actions  including: 

(1)  The  MS  curriculum  should  be  convenient  and  attractive  to  students  so 
they  will  select  MS  courses  -  otherwise  it  may  be  very  difficult  to  recruit 
them. 


(2)  The  host  school  has  a  veto  power  on  the  MS  curriculum.  In  particu¬ 
lar,  the  schools  can  limit  the  number  of  classroom  hours,  number  of  graduation 
credits,  and  which  courses  are  taught.  Some  schools  allow  MS  courses  to  count 
towards  graduation  while  some  do  not, 

(3)  Orders  and  guidelines  from  TRADOC  go  through  the  chain  of  command: 
ODCSROTC  regional  commanders,  PMSs  at  the  ROTC  detachments.  Because  the  two 
other  influences  listed  above  are  non-military  (student  choice  and  school 
choice),  the  ODCSROTC  cannot  order  changes  in  the  ROTc  programs  that  ignore 
the  civilian  influences. 

The  consequences  of  the  myriad  of  influences  in  a  heterogeneous  set  of 
host  colleges  and  universities  leads  to  a  heterogeneous  set  of  ROTC  programs 
(over  ^4 00  of  them). 
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MS  I/MS  II  Class  Sizes 


Some  ROTC  units  recruit  heavily  in  the  freshman  year  and  make  it  very 
attractive  for  students  to  take  MS  1.  At  a  few  schools,  taking  ROTC  in  the 
first  two  years  is  mandatory.  (The  latter  group  includes  the  five  military 
academies,  such  as  the  Citadel,  that  are  modeled  on  the  United  States,  Mili¬ 
tary  Academy  at  West  Point).  Therefore,  the  MS  I  class  enrollment  can  be  very 
large  at  some  schools,  especially  in  the  first  semester.  Attrition  leads  to  a 
considerable  drop  in  enrollment  by  MS  II. 

The  existence  of  large  classes  means  that  implementing  programs  in  MS  I 
can  be  resource-intensive,  especially  given  the  small  percentage  of  MS  I  stu¬ 
dents  who  later  sign  Army  contracts.  The  LEP  program  affected  about  2300  MS  I 
students  in  the  experimental  schools,  and  IE  packets  cost  $4D  per  student. 

Number  of  MS  Hours 

TRADOC  rules  require  that  each  ROTC  unit  have  a  minimum  of  30  classroom 
("contact")  hours  per  year  in  MS  I,  which  is  about  an  hour  a  week  at  most 
schools.  The  minimum  for  MS  II  is  60  hours  per  year.  ROTC  units  can  have 
more  than  the  minimum  hours  if  the  host  schools  agree.  Note  again  that  there 
is  often  little  or  no  graduation  credit  for  MS  hours,  so  that  it  may  be  unrea¬ 
sonable  to  ask  students  to  take  many  MS  hours.  Having  a  MS  course  with  many 
hours  also  makes  it  more  difficult  for  students  to  fit  it  into  their  sched¬ 
ules. 


There  are  "laboratory  hourr"  as  well  as  classroom  hours.  Having  labora¬ 
tory  hours  increases  the  number  of  MS  hours  without  requiring  a  commensurate 
number  of  course  credits.  (The  term  laboratory  is  academic  jargon  and  usually 
does  not  reflect  the  actual  activities).  And  these  activities  vary  across 
ROTC  pregrams.  Some  of  the  typical  activities  are;  physical  education  (PE) 
programs  (satisfying  PE  credits),  marksmanship,  outdoor  activities,  (e.g., 
canoeing),  drill  and  ceremonies,  and  first  aid.  As  this  list  shows,  the  ac¬ 
tivities  are  often  those  that  would  be  attractive  to  many  students.  Also, 
activities  such  as  canoeing  can  be  used  to  obtain  insights  into  the  students' 
leadership  abilities. 

Sequence  and  Content  of  Courses 


TRADOC  specifies  a  core  set  of  topics  to  be  covered  over  the  course  of  MS 
I  and  MS  II.  The  ROTC  units  can  choose  the  semester  or  semesters  during  which 
they  teach  each  topic,  the  sequence  in  which  courses  are  taught,  and  the  num¬ 
ber  of  hours  to  spend  on  each  topic.  There  nre  lesson  guides  (Training  Sup¬ 
port  Packages)  for  most  lessons  and  standards  to  be  met.  However,  as  in  most 
teaching  situations,  the  instructors  have  considerable  latitude  in  what  is 
emphasized.  There  is  no  common  MS  final  exam  that  could  be  used  across  the 
ROTC  system  in  MS  I  and  MS  II.  The  ODCSROTC  monitors  the  conduct  of  MS  I  and 
MS  II,  mainly  through  reviewing  curriculum  plans  and  site  visits  by  ROTC  re¬ 
gional  representatives.  The  major  basis  for  evaluating  the  MS  program  as  a 


17 


whole  is  the  performance  by  cadets  in  the  summer  camp  after  MS  III  and  the 
quality  of  the  officers  who  are  commissioned  from  the  unit.  The  first  check 
on  officer  quality  comes  in  the  Officer  Basic  Courses  (OBCs). 

The  lack  of  strict  standardization  in  the  number  of  MS  hours  and  how  the 
hours  ere  used  leads  to  significant  curricular  variations  from  one  unit  to  the 
other: 


(1)  Some  schools  have  a  relatively  set  sequence  of  MS  courses  that  stu¬ 
dents  must  follow.  At  other  schools,  students  can  choose  from  a  long  "menu" 
of  courses  each  semester,  with  little  or  no  constraint  on  the  order  in  whioh 
they  take  the  courses.  The  major  disadvantage  of  having  a  relatively  long 
menu  of  the  same  courses  each  semester  is  that  the  program  must  offer  many,  if 
not  ell,  of  their  topics  each  semester,  requiring  more  sections  and  instruc¬ 
tors.  The  advantage  of  this  approach  is  thst  it  gives  the  students  considera¬ 
ble  flexibility  and  choice  in  course  selection,  which  may  inorease  the  chance 
that  they  will  take  MS  courses. 

(2)  The  topics  taught  in  the  classroom  vary,  and  the  hours  per  topic 
vary.  If  the  core  topics  specified  by  ODCSROTC  are  taken  oare  of,  the  ROTC 
units  can  bring  in  other  topics  of  their  choosing.  There  is  also  variation  in 
how  the  laboratory  hours  are  used,  as  indicated  above. 

Program  Turbulence 

The  PMS's  and  other  instructors  are  generally  Army  commissioned  and 
non-commissioned  officers  although  sometimes  civilians  teach  seleoted  courses. 
As  officers,  they  usually  follow  the  standard  three-year  tour.  Such  personnel 
turbulence  creates  problems  for  a  longitudinal  research  project  like  LEP.  For 
Instance,  with  respect  to  instructor  training,  new  instructors  will  have  to  be 
trained  each  year  and  some  of  the  trained  instructors  will  be  gone  after  1 
year. 


A  related  issue  is  that  some  newly  assigned  instructors  may  not  report  to 
the  school  until  Just  before  the  start  of  the  school  year.  They  may,  there¬ 
fore,  miss  any  training  programs  that  are  scheduled  before  the  school  year. 

And  they  have  a  lot  to  cope  with  besides  the  intervention  program  that  is 
being  implemented. 

Instructor  Preparation 

The  quality  of  the  preparation  of  officers  to  be  PMS's  and  instructors 
varies,  although  it  seems  to  be  improving  (S.  Prelewicz,  personal  communica¬ 
tion,  April  1985).  There  is  a  need  for  training  in  specific  teaching  skills 
and  other  instructor  responsibilities.  Also,  there  is  a  need  for  a  specific 
orientation  to  the  particular  school  to  whioh  the  instructor  is  assigned. 

It  is  clear  that  the  quwlity  of  the  instructors'  teaching  ability  is 
relevant  for  the  implementation  of  the  LEP  program  and  other  programs. 
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The  ROTC  System  and  LEP 


*  ROTC  Organization  Structure  requires  that  program  steps  must  be  de¬ 
fined  well  before  they  are  put  into  practice  so  that  relevant  orders 
can  pass  through  the  chain  of  command. 

-  The  shortest  acceptable  suspense  date  to  require  of  the  ROTC  units  is 
30  days  after  a  letter  goes  from  0DCSR0TC. 

-  If  neoessary,  faster  action  can  be  obtained  by  phone  calls  to  regions 
who  then  call  the  units.  This  approach  is  frowned  upon. 

*  The  large  size  of  some  MS  1  classes  means  that  implementation  is  re¬ 
source  intensive.  Since  IE  booklets  currently  cost  $40  per  student 
for  MS  I,  this  wes  a  concern. 

-  Large  MS  I  classes  also  require  that  relatively  large  num¬ 
bers  of  instructors  must  be  trained. 

*  The  feet  that  most  MS  I  students  do  not  later  sign  Army  contracts 
means  that  only  a  small  proportion  of  the  IE  trained  students  oan  be 
followed  longitudinally. 

-  One  criterion  for  allowing  an  ROTC  unit  into  the  program  was  that 
there  would  be  a  minimum  number  of  students  that  are  expected  to 
contract  with  the  Army. 

*  The  fact  that  the  host  school  can  veto  curriculum  ohanges  raised  the 
possibility  that  schools  would  veto  the  LEP  curriculum  changes. 

Since  curriculum  changes  can  require  18  months  for  the  approval 
process,  this  was  a  serious  concern. 

*  The  relatively  small  number  of  classroom  hours  in  most  ROTC  units, 
especially  in  MS  I,  make  it  difficult  to  add  a  special  program  like 
LEP  and  still  have  time  to  teach  military  science. 

*  The  variation  in  course  sequences  and  classroom  hours  for  each  course 
aoross  schools  may  create  unwanted  noise  in  the  experimental  results 
across  schools.  It  also  makes  it  difficult  to  create  a  common  sat  of 
curriculum  support  materials  to  relate  IE  and  MS.  We  decided  to  make 
the  curricula  more  consistent  for  the  units  involved  in  the  experi¬ 
ment. 

*  Since,  at  some  schools,  different  students  might  take  their  MS  courses 
in  different  sequences,  it  is  difficult  to  organize  the  teaching  of  IE 
lessons.  In  any  particular  MS  course,  students  would  have  taken  a 
variety  of  MS  couraes  and  a  corresponding  variety  of  IE  courses. 

(This  essumes  that  we  have  embedded  specific  IE  lessons  in  specific  MS 
courses.)  This  problem  wes  also  dealt  with  by  specifying  set  MS  I  and 
MS  II  curricula  for  the  schools  in  the  experiment. 
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*  Personnel  turbulence  is  an  obvious  concern  in  a  multi-year  program. 
There  is  no  real  solution  exoopt  to  train  the  necessary  MS  I  and  MS 
II  instructors  whenever  they  enter  the  program.  Also,  developing  good 
teacher  support  materials  can  ease  the  tasks  of  the  instructors. 

With  this  complex  system  in  mind,  we  will  now  specify  what  is  needed  for 
a  successful  IE  implementation. 


Guidelines  for  a  Successful  Implementation 

Based  on  our  review  of  researoh  and  theory  on  cognitive  skills  training, 
we  identified  guidelines  for  a  successful  Implementation  of  IE  and  an  inter- 
pretable  evaluation. 

1 .  Have  enough  IE  contact  hours 

The  program  was  designed  to  have  many  contact  hours  -  hours  where  a 
teacher  mediates  for  students.  There  may  alao  be  non-contact  homework  hours. 
The  original  IE  field  study  (Feuerstein,  1980)  had  over  200  contact  hours. 
Overall,  it  appears  that  there  should  be  at  least  80  oontact  hours.  It  is 
possible  that  college  students  would  need  fewer  hours  than  adolescents,  but 
this  is  speculation. 

2.  Use  all  the  training  instruments 

It  seems  logical  that  all  the  14  IE  instruments  should  be  used  to  ensure 
training  on  as  many  thinking  skills  as  possible.  But  this  has  not  been  done 
in  any  IE  implementation.  There  should  be  about  10  instruments  so  that  both 
basic  and  advanced  instruments  are  used.  Typically  one  must  conduct  a 
multi-year  program  to  do  a  sufficient  number  of  instruments  and  have  enough 
contaot  hours.  Several  IE  projects  have  ended,  after  one  year,  without  com¬ 
pleting  the  planned  number  of  instruments  (Saveli  et  el.,  1984), 

3.  Train  instructors  well. 

It  is  clear  that  the  teacher-mediator  performance  is  critical  to  the  IE 
program.  Ideally,  instructors  should  not  only  be  trained  well  before  begin¬ 
ning  the  program,  but  should  also  receive  support  during  the  program,  such  as 
the  service  of  visiting  or  on-site  consultants.  Sometimes  training  sessions 
are  distributed  at  different  points  in  the  program.  No  matter  what  the  qual¬ 
ity  of  training,  the  IE  teacher  learns  most  by  actually  teaohing.  Therefore 
the  maximum  effectiveness  of  the  program  would  be  likely  to  occur  with  more 
experienced  instructors— after  training  and  after  teaching  at  least  one  group 
of  students. 

4.  Relate  the  IE  tasks  to  content  topics 

As  disoussed  earlier,  doing  abstract  IE  tasks  will  probably  have  little 
practical  effect  unless  the  cognitive  skills  are  related  and  applied  to  spe¬ 
cific  content  domains.  Bridging  is  one  of  the  key  techniques  for  doing  this. 
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Typically,  IE  training  Is  embedded  in  a  school  environment  where  content  topics 
are  taught.  The  most  natural  type  of  bridging  is  to  bridge  to  the  school  top¬ 
ics.  However,  bridging  need  not  be  restricted  to  such  topics. 

There  ere  several  interesting  related  issues: 

(1)  Will  students  learn  content  topics  better  because  of  IE  training? 

(2)  Will  the  content  hours  "lost"  to  IE  lead  to  a  drop  in  performanc? 

(3)  Should  the  program  be  set  up  so  that  the  IE  teacher  is  also  a 
content  teacher?  This  would  appear  to  facilitate  bridging. 

5.  Build  an  iteration  stage  into  the  Program 

This  recommendation  is  based  on  a  general  modal  of  intervention  as  well  at 
specific  considerations  with  respect  to  the  IE  program.  IE  la  a  complex  pro¬ 
gram  that  usually  is  inserted  into  a  complex  system,  e.g.  a  school  system.  It 
is  difficult  to  optimize  the  intervention  on  the  first  try.  Therefore,  in¬ 
structors  should  do  the  best  they  cat.  with  the  first  intervention,  but  use 
their  experience  to  improve  later  waves  of  intervention.  For  example,  begin  an 
intervention  with  a  fifth-grade  class  one  year,  and  a  year  later  conduct  an¬ 
other  intervention  cn  the  uext  Sth-gradrt  class. 

6.  Monitor  and  control  implementation  quality. 

Even  if  one  designs  a  strong  intervention,  one  should  make  aura  the  pro¬ 
gram  followed  or  exceeded  the  plan.  Surprisingly,  the  quality  of  inter-vantlon 
programs  is  frequently  not  checked  or  is  examined  superficially.  Key  parame¬ 
ters  for  IE  would  include  number  of  IE  contact  hours,  instruments  covered, 
amount  of  homework,  amount  of  bridging,  and  the  quality  of  teacher  mediation. 

7.  Hava  well  e/ecified,  reliable,  and  valid  measures  of  performanc*; 

/ 

Obviously,  it  is  important  to  have  measures  of  performance  that  relate  to 
program  goala  and  that  have  good  psychometric  properties.  Selecting  such  meas¬ 
ures  is  very  difficult,  and  a  more  complete  discussion  of  our  approach  will  be 
presented  in  an  upcoming  report. 

8.  Measure  the  effects  longitudinally. 

Feueratain  (1980)  claims  that  the  effects  of  IE  should  continue  to  show  up 
and  even  become  stronger  for  years  after  the  program  ands.  This  hypothesis  has 
important  implications  and  must  be  tested.  In  addition,  the  ROTC  instructors 
might  benefit  from  teaching  the  program.  Their  careers  and  those  of  the  con¬ 
trol  schools'  instructors  can  be  tracked  in  the  Officer  Longitudinal  Research 
Data  Base  (OLRDB)  that  is  being  developed  (Rachford,  1984). 

The  above  general  guidelines  were  supplemented  by  lessons  learned  in  our 
first  use  of  IE  in  ROTC,  and  in  the  use  of  IE  in  an  Army  Basic  Skills  Education 
Program  (BSEP)  (Ruaa-Kft  and  McLaughlin,  1983). 


These  more  specific  guidelines  Included: 

1.  Obtain  support  from  the  PMSs. 

2.  Develop  curriculum  materials  to  aid  the  integration  of  £E  into 

the  ROTC  curriculum.  - 

3.  Devolop  as  much  consistency  in  the  MS/IE  topic  sequences,  across' 
schools,  as  possible. 


Method  ; 


Major  Design  and  Implementation  Taska 

To  define  the  major  tasks  required  to  implement  and  evaluate  the  LEP  pro¬ 
ject,  we  considered: 

(1)  The  general  implementation  guidelines  presented  above. 

(2)  The  specific  lessons  learned  in  the  first  use  of  IE  in  ROTC  (MS 
III  only)  as  described  in  Rigby  et  al.  (1986) 

(3)  The  analysis  of  ..the  structure  of  MS  1  and  MS  II  as  presented 
above . 

The  major  tasks  are  presented  in  Table  2  along  with  steps  toward  accom¬ 
plishing  the  tasks  in  the  first  school  year.  This  information  is  discussed 
below,  task  by  task. 


Personnel:  From  ARI,  Joel  Saveli  supervised  the  project  and  was  COR  on  the 
contract  with  curriculum  Development  Associates  (CDA).  Paul  Twohig  and  Carlos 
Rigby  were  the  most  Involved  in  the  development  of  curriculum  materials,  de¬ 
signing  the  common  class  schedule  and  observing  the  initial  instructor  training 
session.  Douglas  Rachford  had  the  principal  responsibility  for  defining  quan¬ 
titative  measures  for  the  effect  of  IE,  while  Paul  Twohig  was  principally  re¬ 
sponsible  for  monitoring  the  implementation  through  questionnairas  at  the 
refresher  training  aeaaion.  Major  Jeffary  Anderson  organized  the  conference 
cell  system  and  schedule,  but  ell  LEP  assistance  from  David  Martin  and  Frances 
Shannon  Amquist  demons tra tad  IE  at  tha  PMS  briefing,  developed  final  versions 
of  the  curriculum  materials,  aided  the  design  of  e  common  class  schedule,  con¬ 
ducted  the  initial  instructor  training  end  refresher  sessions,  took  pert  in 
conference  calls,  visited  ROTC  unite,  and  coordinated  the  shipment  of  the  IE 
instruments.  The  ODCSROTC  POC  was  Stephen  Prelewicz.  The  ROTC  SMs  for  devel¬ 
oping  the  curriculum  materiel  were  Major  Loveland  of  South  Caroline  State  Uni¬ 
versity  (MS  Ill)  and  Captain  Beene,  Universityu  of  Arkansas,  Fayetteville  (MS 
II).  ROTC  instructors  and  regional  POCs  are  listed  in  Appendix  B. 


Table  2 


LEP  Inolanantatloo  Goals  and  Taske 

Coala 

Bafota  the  1984/85 

School  Year 

During  the  First 

Saeaater 

During  the  Second 

SMMfr 

Define  hcparimantel 
Design  aad  Select 

ROIC  tbits  for 
Experiment 

*  Develop  deaipi 

*  Draw  temple  of 
schools  (ROIC  Unite) 

*  ODCSROIC  lafonaa 

ROIC  Units  of  Involvement 

Gat  Program  Support 
Within  R01C 

*  Brief  PMSe  and 

Region  POCe 

Daflna  Camon 
dan  Schedule 

*  Get  Information  on  currant 
achadula  at  IMS  netting 
and  fean  ODCSROIC, 

*  Daflna  achadula  at  toes  tinge 
of  SMEs,  AR1,  Con  tractor 

Develop  Curriculum 
Support  Materialc 

*  Bee  Inc  to  cm  ideas  at  easting 
of  S4Es,  ARI  and  contractor 

*  Contractor  pnparae  MS  I 
materials  for  ARI  OCR  approval 

*  ROIC  urita  uaa 
aster  isle 

*  ROIC  units  uaa  materials 

*  Revise  MS  1  materials 
based  on  Instructor 
faaback 

*  Prepare  MS  11  mater  laic 

IE  ftalnlig  Material* 
Delivered  to  tbita 

*  ARI  gats  aitlmAta  of  MS  I 
enrollments  and  contractor 
coordinates  delivery. 

Define  Potential 
Bvaluatln  Measures, 
Design  teat  anauar 
cheat  and  packets  to 
aaod  uolta. 

*  Maasuraa  defined 
and  packets  designed 

*  Tests  mailed  to 

ROIC  units 

*  Second  mailing  of 

tasta 

Train  Inetructora 

*  Primary  Toalnlng  Session 

8/84 

*  Make-up  Training 
Session,  9/84 

*  Ref reaber  Training  and 
Feedback  Session,  2/85 

Provide  lac  true  tor 
Support 

*  Individual  phone 
calls,  ccofarsoca 
call* 

*  Individual  phone  calls 

*  Ref raster  Session 

2/85 

Monitor  lnplaman  nation 

*  Gooferanc a  Cklla, 

*  Instructor 
questionnaires 

*  Contractor  Site  Visits 
4-5/85 

Oat  Feedback  on 

Program 

*  Conic ranoe  calls 

*  Inc  true  tor/Studant 
quae  donna  ires 

*  Refresher  Session  2/85 

*  Contractor  Sits  Visits, 
4/85 
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Experimental  Design  and  Selection  of  Units 


The  moat  baale  dealgn  decision  was  to  have  ROTC  units  be  either  experi¬ 
mental  (LEP)  or  control  (no  LEP).  It  was  not  deemed  practical  to  have  LEP 
and  non-LEP  classes  within  the  same  ROTC  detachment.  We  decided  that  having 
13  schools  in  each  condition  would  give  a  good  balance  between  the  need  for 
generalizability  and  the  program  cost.  (We  had  12  schools  per  conditiou  in 
the  previous  IE  implementation,  Rigby  et  al.,  1986). 

Because  of  the  concern  of  the  ODCSROTC  with  respect  to  OBC  failures,  we 
planned  to  include  in  our  sample  ROTC  units  with  relatively  high  failure 
rates.  Therefore,  one  measure  of  the  effectiveness  of  LEP  would  be  the  pro¬ 
portion  of  OBC  failures  at  experimental  vs.  control  schools.  To  make  the 
results  more  generallzable,  on  this  and  other  measures,  we  did  not  want  to 
restrict  our  sample  to  Just  schools  with  high  OBC  failure  rates.  Therefore 
the  ODCSROTC  provided  us  with  n  list  of  schools  from  Regions  1  and  111  thit 
included  those  with  the  highest  failure  rates  (192)  to  those  with  only  1 
failure  in  3  years. 

We  first  excluded  schools  from  the  sample  on  the  following  bases: 

(1)  where  the  number  of  graduating  cadets  was  too  small  for  meaning¬ 
ful  analysis. 

(2)  where  English  was  a  second  language  for  a  large  proportion  of 
the  students.  (This  factor  could  create  additional  "noise"  in 
the  results.) 

The  remaining  pool  of  schools  contained  a  significant  number  of  Histori¬ 
cally  Black  Colleges  (HBCs).  Since  this  group  of  schools  has  a  significantly 
different  history  from  the  other  schools  in  the  sample,  we  decided  to  do 
stratified  random  sampling:  HBC  vs  non-HBC  schools.  This  sampling  plan  gave 
us  an  equal  proportion  of  HBC  schools  in  the  experimental  and  control  condi¬ 
tions,  eight  HBCs  and  five  non-HBCs.  (For  practical  reasons  the  8/5  split 
was  not  followed  in  year  84/85,  see  below.  The  list  of  schools  is  given  on 
page  A-2  of  Appendix  A;  the  original  list  is  on  page  B-8  of  Appendix  B. 

The  LEP  project  was  designed  to  run  for  two  years  (MS  I  and  MS  II),  which 
is  a  typical  duration  for  an  IE  implementation.  However,  we  decided  to 
have  two  two-year  Implementations  with  overlap:  one  starting  in  the  school 
year  1984-85  and  the  other  beginning  in  1985-86.  This  plan  is  presented  in 
Figure  3. 


Research  Design 


COHORT  1 

COHORT  2 


*  There 


1984-85  1985-86 

MS  1  MS  II 
LEP  TRAINING* 


1986-87 
MS  III 

Advanced  Camp 


1987-88  Post- 

MS  IV  Commissioning 
Commissioning  OBC 


MS  I  MS  II 
LEP  TRAINING* 


MS  III  MS  IV 

Advanced  Commissioning 
Camp 


a  corresponding  set  of  control  (non-LEP)  units  in  each  period 


Figure  3 


'ihe  major  reasons  for  this  approach  are  as  follows: 

(1)  Lessons  learned  from  the  first  cohort  could  be  used 
to  revise  procedures  for  the  second  cohort. 

(2)  It  was  not  certain  that  the  ROTC  units  could  revise 
their  curriculum  according  to  our  guidelines  for  the 
first  school  year  due  to  host  school  rules  and  other 
practical  considerations. 
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One  example  of  how  lessons  learned  would  be  used  is  with  respect  to  the 
curriculum  support  materials  (see  Table  2).  The  plan  was  to  develop  an 
initial  set  of  MS  I  materials  prior  to  the  first  semaster  and  use  them 
during  1984-85.  These  materials  would  be  revised  late  in  the  year  for  use 
in  the  next  MS  I  class  in  1985-86. 

A  major  consequence  of  this  design  is  that  the  implementation  should  be 
more  effective  for  the  second  cohort.  It  was  expected  that  program  evalua¬ 
tion  would  be  more  meaningful  for  that  cohort. 

Getting  Support 

We  began  the  LEP  program  with  the  strong  support  of  the  DCSROTC,  pri¬ 
marily  on  the  basis  of  the  reactions  of  students  and  instructors  that  were 
involved  in  the  first  IE  implementation.  We  still  needed  to  obtain  support 
from  the  units  involved  in  the  experiment  and  from  the  ROTC  regions. 

To  this  end,  we  briefed  the  PMSs  (or  their  representatives)  from  the 
experimental  schools  and  representatives  from  Regions  I  and  III.  The  pres¬ 
entation  included  information  on  the  overall  program  and  a  brief  demonstra¬ 
tion  of  the  IE  method. 

The  response  of  the  PMSs  was  very  positive  with  the  exception  of  one 
PMS.  His  request  that  his  school  be  dropped  from  the  experiment  was 
granted.  A  PMS  from  a  designated  control  school  voluntarily  attended  the 
briefing  and  asked  that  his  school  be  put  into  the  experimental  group  -  it 
was.  The  final  schools  selected  are  shown  on  page  A-2  of  Appendix  A. 

There  also  was  a  positive  response  from  the  regional  POCs.  In  retro¬ 
spect,  we  saw  a  value  in  briefing  other  region  staff  officers,  particularly 
those  at  the  higher  ranks  to  keep  as  many  of  the  key  personnel  as  informed 
as  possible. 

In  addition,  we  received  initial  information  on  the  curricula  at  the 
ROTC  units  from  the  PMSs  which?  were  used  to  define  a  more  consistent  se¬ 
quence  of  topics  across  the  units.  Further  information  was  gathered 
through  phone  calls  to  ROTC  units  and  ROTC  headquarters. 

Designing  Curriculum  Mater ials/Topic  Schedule 

Once  the  participating  detachments  were  defined  and  program  support  was 
developed,  we  could  work  on  reducing  the  inconsistency  in  the  sequences  of 
course  topics  from  school  to  school.  With  uniform  sequences,  we  could  more 
easily  develop  curriculum  materials  to  support  the  instructors.  It  should 


26 


be  noted  that  TRADOC  provides  guides  for  teaching  military  science  (MS) 
subjects  called  Training  Support  Packages.  There  is  also  a  potentially 
integrative  leadership  manual,  EM-22- 100.  But  commonly  this  manual  is  used 
only  when  leadership  theory  is  explicitly  taught  and  1b  not  always  used 
throughout  MS  I  and  MS  II. 

In  addition,  the  IB  program  provides  a  detailed  teacher's  guide  for 
each  instrument.  What  was  needed  was  support  materials  to  help  the  in¬ 
structors  relate  the  cognitive  skills  trained  in  IE  to  MS  subjects. 

The  general  strategy  for  materials  development  was  first  to  develop 
draft  curriculum  materials  through  meetings  of  Subject  Matter  Experts 
(SMEs),  ARI  personnel,  and  the  contractor  representatives.  Then  the  con¬ 
tractor  would  develop  draft  materials  for  approval  by  the  ARI  Contracting 
Officer's  Representative  (COR)  and  revise  according  to  COR  guidance. 

There  were  two  meetings  of  SMEs,  contractor's  representatives,  and  ARI 
personnel.  The  SME's  were  two  ROTC  instructors.  One  had  used  IE  in  MS  III 
and  one  in  MS  II  (footnote  4).  The  use  in  MS  II  was  a  one-school  pilot 
falling  between  the  earlier  MS  III  implementation  and  the  subsequent 
(1984-85)  MS  I  implementation. 

The  results  of  the  effort  to  define  a  more  consistent  curriculum  se¬ 
quence  is  shown  in  Appendix  B,  as  an  attachment  to  a  letter  from  the 
DCS ROTC.  This  plan  tried  to  strike  a  balance  between  creating  consistency 
and  allowing  some  flexibility  for  the  varied  programs. 

*  The  plan  was  set  up  based  on  the  minimum  number  of  classroom  hours, 

30  in  MS  I,  60  in  MS  II. 

*  The  IE  instruments  and  hours  were  specified. 

-  IE  hours  (including  pre-post  measures)  took  about  half 
the  minimum  MS  I  curriculum  and  24/60  of  the  MS  II 
class  hours. 

*  A  "common  core"  approach  was  used.  That  is,  only  some  of  the  re¬ 
quired  topics  were  assigned  sequence  positions,  and  not  all  of  the  minimum 
hours  were  scheduled. 

-  For  schools  with  the  minimum  number  of  hours,  there  was  no  flexi¬ 
bility  in  MS  I.  But  there  were  scute,  open  hours  in  MS  II. 

The  "free"  hours  could  be  used  for  unscheduled  TRADOC-requi red 
courses  or  PMS-selected  topics. 
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With  the  curriculum  defined,  we  could  then  more  easily  prepare  support 
materials.  After  brainstorming  ideas  and  formats  at  the  meetings,  two 
types  of  materials  (manuals)  were  developed. 

The  first  was  the  Bridging  Manual  (BM)  for  LEP  in  MS  I  which  mostly 
contained  a  set  of  bridging  ideas  for  relating  MS  topics  and  IE  cognitive 
principles  (Appendix  C) .  Recall  that  bridging  involves  the  application  of 
abstract  cognitive  principles  in  some  content  area.  The  BM  is 
cross-referenced  such  that  one  can  look  up  an  IE  instrument  and  find  MS 
applications.  Or  one  can  look  up  an  MS  topic  and  find  out  what  cognitive 
principles  are  applicable.  Thus,  whether  instructors  were  planning  an  IE 
class  or  an  MS  class,  they  could  easily  find  bridges.  Instructors,  of 
course,  had  the  option  to  use  their  own  bridges.  The  BM  also  contained 
model  lesson  plans  for  each  IE  class,  to  be  followed  at  the  instructor's 
option.  And  there  was  a  master  schedule  of  the  IE/MS  topic  sequence. 

The  second  manual  was  the  Work  Journal  Manual  (WJM) .  In  the  Work 
Journal  (WJ)  aspect  of  the  LEP  program,  students  had  to  keep  a  notebook 
containing  homework  or  class  writing  assignments.  The  WJM  provided  in¬ 
structors  with  suggested  assignments  for  each  IE  class.  An  example,  is 
shown  in  Figure  4.  The  purpose  of  these  assignments  was  to  give  students 
practice  in  applying  cognitive  skills  and  increasing  the  student's  aware¬ 
ness  of  his  or  her  cognitive  processes.  Using  the  WJ  is  also  consistent 
with  the  recent  TRADOC  emphasis  on  having  writing  assignments  in  Amy 
schools,  e.g.,  Command  and  General  Staff  College  (CGSC) . 

The  WJM  was  developed  specifically  for  the  IE/ROTC  integration  and  is 
an  example  of  how  LEP  became  less  of  a  pure  IE  program  and  more  of  an 
ROTC-oriented  program. 
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Work  Journal  Aaalgnaent  Sample 


Chocking  for  Errora 


Think  nbout  olcuatlona  where  chocking  for  ocroro  night  bo  cruclol.  Wrlto 
down  aono  of  your  thought!  about  how  o  military  loodor  night  chock  for  er- 
roro.  What  about  you?  Whara  do  you  chock  for  orror  on  taats,  in  driving,  Id 
noklag  judgaonto  or  doclolona,  or  whon  making  o  purchaao?  Can  you  think  of  a 
altuatlon  whoro  failing  to  chock  for  orrora  could  ondangar  aonoono'a  Ufa? 


•  Sooplo  Journal  Entry: 

S  Da  to:  January  20,  1985 
j  Topic:  Chocking  for  Errora 


I  ha vo  a  frlond  who  playa  football  for  tha  collage.  After  each 
gano  tho  toon  and  coacnaa  watch  tho  video tapoa  of  tha  gano  and 
they  talk  about  all  tho  alatakoa  tho  playora  nado  and  how  to  pre¬ 
vent  than  naxt  tine.  Sono tinea  the  orrora  ara  In  tho  quarterback 'a 
plan,  but  aono tinea  tho  guya  juat  got  confuaed  or  aloppy  and  run 
tha  wrong  way  or  botch  the  play. 

I  bought  a  uaod  car  laat  year,  and  we  had  a  mechanic  chock  It  for 
problona.  Alao  I  proofread  ny  paper*,  ao  I  do  chock  for  orrora. 

1  never  thought  about  endaogarlng  aonoono'a  ltfa  If  you  didn't 
chack  for  orror.  1  think  oa  tho  battlefield  It  night  bo  important 
to  chock  tho  lnatructlona  or  chock  a  location  with  a  conpaaa,  ao 
you  didn't  accidentally  wander  luto  enony  territory.  It  haa 
happened  that  of fleer a  have  given  a  wrong  location  and  accidon tally 
called  in  fir*  on  thonatlvoa.  Certainly  the  chocking  of  connorcial 
alrplanoa  hofor*  take-off  ia  a  utter  of  Ilf*  and  doath. 


Self  Evaluation: 

Your  Journal  entry  ahould  demons trate  your  ability  to  define  a  problem,  per¬ 
ceive  eh*  errora  logical  to  that  problem,  and  analyze  the  atrategiea  for 
prevention  of  errora. 


Figure  4 
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Instructor  Training  and  Support 


To  train  tha  ROIC  Instructors,  s  tan-day  sssslon  was  bald  at  Ft.  Monroe, 
TRADOC  HQ.  Tbs  IE  training  was  conducted  by  Frances  Link  of  Curriculum  De¬ 
velopment  Aasociataa,  with  part-time  help  from  bar  associates. 

Twenty-two  HE  1  instructors  wars  trained  along  with  tha  two  regional 
POCs  and  tha  PMSs  from  two  units  (Appendix  D).  Tha  goal  was  to  train  all  tha 
Ms  I  instructors  from  tha  experimental  schools.  (Tha  two  PHSs  volunteered  to 
attend  due  to  their  interest.  One  PMS  did  decide  to  teach  In  MS  1).  Unfor¬ 
tunately,  several  instructors  wars  assigned  too  lata  to  their  units  to  attend 
the  training  sessions  and  had  to  attend  a  make-up  session  shortly  aftar  the 
sure  of  the  school  year. 

The  initial  training  technique  was  for  tha  trainees  to  take  the  stu¬ 
dents'  role  and  learn  tha  approach  from  interacting  with  the  trainer  and 
observing  the  trainer.  Towards  the  and  of  the  session,  the  MS  instructors 
did  mors  and  more  practice  teaching  of  IE. 

It  appeared  to  the  first  author,  who  attended  the  entire  session,  that 
the  instructors  showed  an  adequate  level  of  proficiency  by  the  end  of  the 
training  session.  It  should  be  understood  that  training  prior  to  teaching 
can  only  go  so  far  with  a  complex  program  like  IE.  There  la  a  lot  of 
learning-by-dolng  prior  to  attaining  proficiency.  The  ROTC  instructors 
showed  the  potential  to  continue  to  learn  the  method. 

At  tha  end  of  the  training  session,  tha  instructors  were  surveyed  with 
respect  to  their  opinions  about  their  IE  training,  thalr  preparation  for  IE, 
and  LEP.  The  gist  of  the  results  was  that  (1)  they  ware  extremely  enthusias¬ 
tic  about  the  quality  of  tha  training  and  (2)  they  were  positive  about  the 
potential  value  of  LEP  for  their  students.  On  the  other  hand,  they  were 
concerned  about  (1)  their  mastery  of  the  IE  method  (aoe  above  remark  on 
learning-by-dolng)  and  (2)  tha  time  constraints  on  teaching  both  LEP  and  MS. 

Overall,  then,  the  instructors  seemed  to  leave  with  a  positive  attitude 
towards  the  program  and  the  Intention  to  make  the  implementation  es  atrong  as 
poesible. 

This  may  be  a  proper  piece  to  bring  in  the  Important  issua  of  the  affact 
of  tha  LEP  program  on  the  instructors.  Of  course,  the  program  was  davslopad 
to  aid  potential  officers.  But  anyoua  who  has  taught  knows  bow  much  you 
laarn  about  c  topic  through  teaching  it.  Mot  only  should  tha  instructors 
have  learned  mors  about  cognitive  skills  and  their  own  thinking  styles,  but 
they  rscaived  training  and  experience  in  important  interpersonal  skills.  Tha 
in terse tiva  style  of  teaching  uses  many  of  the  skill a  required  to  be  an  af¬ 
fective  teacher-leader.  One  of  tha  reasons  the  instructors  wars  so  enthusi¬ 
astic  about  the  training  session  wan  tha  lessons  learned  in  intaractiva 
teaching.  The  instructors  spontaneously  bought  a  journal  for  the  trainer, 
end  14  of  them  wrote  personal  comments  about  what  they  got  from  the  training 
session.  One  officer  wrote  that  it  was  the  "bast  Army  training  ha  had  ever 
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bad"  (emphasis  added).  This  and  other  comments  showed  that  the  instructors 
viewed  the  training  session  as  personally  developmental  and,  presumably,  that 
development  would  continue  through  teaching  LEP. 

These  speculations  concerning  instructor  development  could  be  evaluated 
by  tracking  the  careers  of  instructor*  from  the  LEP  schools  and  control 
schools. 

Make-up  Training  Session 

As  mentioned  earlier,  some  MS  1  instructors  did  not  report  to  their  unit 
until  after  the  ten-day  training  session.  Therefore  it  was  necessary  to 
conduct  a  three-day  training  session  for  these  five  instructors  shortly  after 
the  start  of  the  school  year.  Three  of  the  instructors  came  from  a  school 
with  two  trained  MS  1  Instructors  who  could  coach  them.  The  other  two  in¬ 
structors  came  from  a  school  where  only  a  MS  1X1  instructor  had  been  trained. 
The  instructors  are  listed  in  Appendix  D.  The  training  session  went  well,  and 
the  Instructors  appeared  to  be  reasonably  prepared  to  conduct  LEP.  But  we 
did  not  expect  thee  to  be  as  prepared  as  those  that  attended  the  ten-day 
session. 

Instructor  Support  During  School  Tear 

Teaching  LEP  Is  a  complex  task,  and  the  instructors  need  support.  In  a 
high  school  it  is  relatively  easy  to  provide  IE  experts  who  can  observe  and 
meet  with  Instructors  on  a  regular  basis  and  counsel  them  on  their  teaching. 
Thle  type  of  support  is  not  practical  with  a  widely  distributed  group  of  ROTC 
units.  Instead,  we  used  the  following  methods  to  support  Instructors: 

(1)  Phone  calls  to  individual  units, 

(2)  Conference  calls  Involving  several  units, 

(3)  Bringing  all  the  Instructors  to  a  central  place, 

(4)  Site  visits  by  the  trainer. 

Individual  Phone  Cells.  The  instructors  had  the  option  of  calling  ARI 
personnel  or  the  trainer  for  any  questions  they  had.  Also,  ARI  researchers 
periodically  called  the  units  to  find  out  if  the  instructors  needed  any  help. 
Mot  much  information  was  passed  on  concerning  teaching  strategist  by  this 
route. 


Conference  Calls.  We  scheduled  conference  calls  with  groups  of  schools 
in  the  first  seme a  ter  of  the  program.  All  the  ROTC  unite  were  eventually 
Involved  in  a  conference  call.  The  only  unit  involved  in  more  than  one  call 
was  Alcorn  State;  we  had  to  cover  the  two  mete  of  instructors  who  were 
trained  in  different  training  sessions.  The  conference  cells  sssmsd  to  b* 
successful  in  giving  us  a  picture  of  now  the  LEP  classes  were  going  and  of 
providing  the  ROTC  instructors  with  some  advice  end  guidance.  . 
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Instructors'  Refresher  Course.  The  instructors  were  brought  together 
early  in  tbs  second  semester  to  sbsre  ideas,  successes  end  problems,  end  to 
receive  further  training  in  the  IE  methodology.  The  meeting  was  also 
attended  by  the  trainer  and  the  first  author.  This  seemed  to  be  sn  efficient 
way  to  exchange  information  or  teach  approaches  and  to  fill  in  some 
of  the  gaps  in  training. 

Site  Visits 

All  of  the  above  methods  for  instructor  support  have  advantages  and 
disadvantages.  But  in  each  case  the  teaching  experiences  are  just  talked 
about.  We  decided  that  we  had  to  have  some  direct  observation  of  how  the  LEP 
classes  were  conducted.  Therefore  EOTC  units  were  visited  to  evaluate  how 
well  LEP  was  being  taught  and  to  give  guidance  on  teaching  LEP. 

Defining  Potential  Evaluation  Measures 

The  first  working  guideline  wai  to  use  measures  of  a  wide  range  of 
constructs.  Obviously,  the  most  relevant  measures  would  be  indicators  of 
such  cognitive  skills  as  classification,  problem  solving,  making  comparlaona, 
etc.,  since  these  are  the  skills  that  are  supposed  to  be  trained  by  IE.  But 
IE  is  also  supposed  to  affect  cognitive  styles,  so  measures  of  cognitive 
styles  constructs  sre  relevant.  If  IE  training  improves  cognitive  perform¬ 
ance,  it  might  affect  the  personality  and  behavior  of  students;  e.g.,  motiva¬ 
tion,  self-concept,  expressiveness.  So  there  are  arguments  for  using 
measures  of  personality,  motivation,  and  degree  of  participation  in  class. 
Finally,  changes  in  the  above  constructs  are  not  relevant  for  the  basic  goals 
of  LEP  unless  they  affect  performance  in  leadership  tasks.  Thus,  It  should 
be  clear  why  we  considered  a  wide  range  of  evaluation  maaaurea. 

Another  working  guideline  wee  that  our  research  would  require  longitudi¬ 
nal  data  gathered  over  a  period  of  years.  At  a  minimum,  there  should  be 
measures  at  the  start  end  end  of  the  two-year  implementation  for  e  pre-post 
comparison.  We  also  planned  to  get  date  after  the  program  ended: 

(1)  for  etudents  who  contracted  into  ROTC. 

(2>  for  those  who  were  commissioned  and  attended  au  Officer  Basic 
Course  (OBC). 

We  had  to  temper  our  evaluation  daaign  due  to  the  limited  number  of 
classroom  hours  that  we  could  use  for  testing  (2  hours  in  MS  1).  Other  peri¬ 
ods,  such  as  MS  laboratory  end  non-cless  hours  were  prohibited,  at  least  in 
the  first  year  of  the  program.  Our  strategy  was  to  choose  a  limited  number 
of  tests  for  in-class  administration  and  gat  other  data  that  was  collected  on 
the  students  by  TRAOOC. 

The  measures  in  our  evaluation  plan  fell  into  three  categories: 

(1)  Measures  selected  by  ARI  for  specific  inclusion  in  the  LEP 
evaluation  and  to  be  taken  in  LEP  claaa  time. 
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(2)  Paper-and-pencil  measures  that  ODCSROTC  used  in  all  ROTC 
unit*  regardless  of  thalr  Involvement  in  LEP. 

(3)  Other  Matures  of  performance  in  a  cadet's  career,  especially 
those  related  to  officer  performance.  All  three  groups  of  meas¬ 
ures  ere  summarised  in  Table  3. 

The  ASI-deflnad  measures  were  aimed  at  cognitive  skills  end  cognitive 
styles  constructs  since  these  constructs  were  most  directly  related  to  the 
goals  of  the  IE  training.  We  defined  two  potential  measures  of  cognitive 
skills: 

<1)  The  Problem  Solving  Test  (PST): 

The  PST  is  a  pictorial,  non-verbal  problem  solving  test,  somewhat  like 
the  better-known  Ravens  Progressive  Matrices  test.  It  was  designed  for 
one-to-one  administration,  and  our  uss  la  group  teatiag  was  a  non-standard 
situation.  We  had  permlsaion  from  the  PST  developers  to  i; try  the  PST  on  our 
samples  in  exchange  for  information  on  the  psychometric  analysis. 

'I  , 

(2)  Sections  of  the  Army  Classification  Battery  (AGB): 

The  ACB  le  a  1.5. Army  general  test  of  cognitive  ability  end  achievement 
with  varied  subtesta.  It  is  similar  to  e  commercial  test,  the  Differential 
Aptitude  Test.  We  used  four  of  the  tub teats: 

Arithmetical  Reasoning 

Word  Knowledge 

Pattern  Analysis 

Mechanical  Comprehension 

Since  the  ACB  io  no  longer  an  operational  test,  it  was  available  for 
research  use. 

(3)  Decision  Styles  Inventory  (DS1): 

The  DSI  is  e  measure  of  cognitive  styles  end  has  bean  usad  in  raaaarch 
on  officers.  It  has  two  dimensions,  each  with  two  sub-categories.  One  di¬ 
mension  contrasts  the  orientation  towards  ideas  or  concepts  vs.  preferring  e 
more  hands-on,  action  approach.  Ths  other  distension  contrasts  the  analytic, 
component  by  component  thinking  style  with  u  more  holistic  style. 
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Table  3 

Evaluation  Measures 


AR1-Defia«d  Measures 

*  Cognitive  Ability 

-  Problem  Solving  Test 

-  Army  Classification  Battery  Subteste 

-  Selected  IE  Training  Tasks 

*  Cognitive  Style 

-  Decision  Styles  Inventory 

ODCSROTC  Achievement  Testing 

*  Basic  Skills  Tests 

-  Nelaon-Denny 

•  Missouri  College  English 

-  Stanford  Math  Achievement 

*  Leadership  Potential 

•  Officer  Selection  Battery 

Leadership  Performance 

*  NS  111  Summer  Camp 

*  Officer  Basic  Course 

General  Comps tance 

*  Grade  Point  Average 
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(4)  Instrumental  Enrichment  leaks: 

V*  also  chosa  selected  IE  training  tasks  for  pre-post  measures.  We 
expected  a  strong  increase  in  performance  on  these  problems  due  to  the  direct 
IE  training.  But  these  measures  are  useful  as  checks  that  .there  was  at  least 
a  minimum  of  X£  training  and  practice.  We  chose  ZE  pages  that  were  not  to  be 
used  in  the  LEP  program  to  minimize  the  uea  of  problem  solving  by  direct 
recall  from  memory. 

Both  the  ACB  end  JPST  have  two  forms  end  therefore  can  easily  be  used  as 
pre-poet  measures.  There  were  enough  similar  IE  task  pages  so  that  we  had 
fairly  equivalent  pre-poet  IE  tasks.  The  DSI  only  haa  one  form. 

For  the  PST,  ACB  and  DSI,  special  machine  scores ble  answer  sheets  were 
designed.  In  feet  the  DSI  had  items  end  response  blocks  on  the  earns  sheets. 
The  testing  in  the  LEP  program  wee  atypical  for  all  three  tests;  the  PST  is 
not  normally  a  group  teet  end  we  changed  the  format  of  the  DSI.  Also,  we  were 
using  only  pert  of  tbo  ACB. 

Because  of  the  limit  on  classroom  hours  we  could  not  use  mil  these  tests 
in  evsry  school.  We  also  were  using  teste  In  atypical  ways  on  a  specific 
sample  of  schools.  Therefore' we  decided  to  use  the  psychometric  analysis  of 
the  results  of  those  teste  with  the  first  cohort  to  help  select  the  best 
tests  for  later  evaluating  the  LEP  program.  The  selected  tests  could  be  used 
as  pre-poet  measures  for  the  second  cohort. 

Each  ROTC  unit,  experimental  or  control,  wee  sent  only  some  of  the 
testa.  But  ovsrell  the  distribution  of  tests  and  test  forms  was  designed  to 
help  ue  select  the  beet  measures  for  evaluating  LEP.  The  reeults  of  tbi 
psychometric  analysis  will  be  published  in  a  later  report. 

Besidaa  the  teste  defined  by  AR1,  the  ODCSROTC  bed  selected  a  eat  of 
paper  end  pencil  tests  as  pert  of  its  program  to  maintain  the  quality  of 
pre-commiesioning  programs.  Tssts  art  to  be  given  in  freehmen  and  senior 
years  providing  long-interval  pre-post  measures.  As  shown  in  Table  3,  three 
of  the  teats  tap  basic  skills.  Tho  other,  the  Officer  Selection  Battery 
(OSB),  is  e  general  teet  that  has  been  validated  on  OBC  performance  (Fiscal, 
Edwards,  Claucly,  &  Kumsay,  1983). 

Other  measures  pertain  more  divoctly  to  the  roles  of  officers  and 
leaders.  There  era  e  variety  ol  measures  in  the  summer  advanced  camp 
after  the  junior  year.  Cadets  ers  evaluated  on  cognitive,  leadership 
end  other  dimensions.  After  e  cadet  is  commissioned,  he  or  she  will  go 
to  an  OBC.  Again  there  ere  e  variety  of  technical  and  leadership  tasks 
available  for  evaluation.  Attendance  OBCs  would  occur  about  two  years  after 
the  IE  implements tion,  which  ia  enough  tiaa  for  the  IE  end  uon-IE  groups  to 
diverge  In  performance  based  on  prior  research  (Feueretelu,  1980). 
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Monitoring  the  Implemen tattoo 


The  quality  of  implemen ration  was  monitored  aalnly  by  cbacking  if  tha 
Instructors  wars  abla  to  follow  tbs  LEF  plant 

(1)  Taach  at  laaat  tha  nlnlauo  IE  houra  that  wars  apaciflad. 

(2)  Covat  tba  apaciflad  IE  instruments. 

(3)  Use  IE  pages  as  homework  regularly, 

(4)  Conduct  tba  work  journal  program  as  designed. 

(5)  Be  abla  to  conduct  tha  IE  classes  using  the  recommended  teaching 
approaches;  e.g.,  bridging. 

Our  major  approaches  to  program  monitoring  involved  gathering  information 
from  the  instructors  on  how  tha  program  was  being  implemented.  Wa  got  this 
information  when  we  were  directly  interacting  with  them,  over  tha  phone  or 
face  to  face;  that  is,  all  the  times  wa  ware  providing  support.  (Sea  previ¬ 
ous  section  on  Instructor  support.)  Ve  also  recrived  written  feedback  at  tha 
and  of  tba  first  semester  by  using  two  forma  for  tha  instructors; 

(1)  The  Beale  Class  Record  (BCR),  which  is  basically  a  listing  of 

the  topics  covered  (Appendix  E). 

(2)  The  Instructors  Insights  Questionnaire  (I1Q)  which  required  de¬ 
tailed  responses  with  respect  to  tha  Instructors'  experience  with 
LEP  (Appendix  F) .  These  questionnaires,  therefore,  provided  infor¬ 
mation  on  tha  perceived  effectiveness  of  tba  program  as  wall  as  on 
Implementation. 

The  Information  on  implementation  has  bean  integrated  from  these  sources 
and  is  summarized  balow. 

Results 

The  only  results  obtained  are  with  respect  to  the  quality  of 
implementation  from  FY  64-85. 

Meeting  Basic  Specifications 

1.  The  specified  minimum  number  of  IE  hours  were  taught.  One  detach¬ 
ment  with  more  available  classroom  houra  was  abla  to  spend  about 
twice  as  much  class  time  on  IE  as  tha  other  schools. 

2.  Tha  specified  IE  instruments  were  covered,  although  the  recommended 
sequence  was  shifted  at  the  discretion  of  the  Instructors, 

3.  Instructors  selected  the  IE  pages  that  they  wished  to  use  in  class 
or  for  homework. 
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4.  The  instructors  assigned  IE  pages  for  homework. 

5*  The  instructors  conducted  the  Work  Journal  aspect  according  to 
specified  guidelines. 

6.  At  two  &0TC  units  the  entire  LEP  program  had  to  be  done  in  one  se¬ 
nes  ter  because  the  MS  topics  were  organized  for  one  semes ter.  This 
neant  that  the  Instructors  did  the  LEP  MS  1  program  twice  in  one 
year. 

Thun  the  essentials  of  the  overall  implementation  plan  vara  act  by  all 
the  ROTC  units.  This  outcome  contrasts  with  the  more  varied  Implementation 
in  the  prior  use  of  IE  in  ROTC  (Rigby  et  al.,1986).  The  major  reason 
for  differences  is  probably  that,  in  the  later  project,  we  had  more  time  to 
obtain  program  support  and  to  provide  program  direction  and  instructor 
support. 


Approach  to  Class  Preparation 

1.  Instructor  preparation  time  for  IE  classes  ranged  from  1.5  to  3 
(tours.  Preparation  time  for  MS  (no-IE)  classes  was  less  tnan  an 
hour. 

2.  The  coordination  between  instructors  at  an  ROTC  unit  varied.  (Mote 

that  for  three  units  there  was  only  one  instructor  and  there  were  no 
other  instructors  for  coordination  of  IE  lesson  plana).  At  a 
minimum,  the  instructors  talked  over  general  approaches  and  shared 
ideas.  At  some  units,  the  Instructors  came  up  with  a  common  lesson 
plan  for  each  IE  class. 

3.  Instructors  made  slight  adjustments  In  their  approaches  as  they 
learned  what  worked  in  prior  classes. 

4.  At  one  school  (Alcorn  State)  the  instructors  tried  out  preeentatione 
on  etch  other. 

Conducting  IE  Cleeses 

1.  The  IE  homework  was  typically  reviewed  in  aach  IE  claas  for  about 
10-15  minutes. 

2.  The  Work  Journal  entries  ware  also  discussed,  usually  by  having 
volunteers  read  entries  aloud.  At  one  achool  the  Work  Journal 
entries  ware  written  in  claas,  not  for  honawork. 

3.  The  instructors  ware  able  to  apply  the  IE  methodology  to  a  varying 

degree : 

a.  Instructors  felt  they  were  able  to  do  an  adequate  amount  of 
mediation  of  IE  tasks. 
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b.  They  frequently  answered  students'  questions  in  class. 

c.  There  was  a  substantial  amount  of  in-class  discussion. 

d.  For  most  Instructors,  there  was  little  opportunity  to  aodel 
affective  thinking,  due  to  time  constraints. 

e.  About  half  the  units  regularly  stopped  the  dess  to  refer  to 
standard  references;  e.g.,  dictionaries. 

f.  Using  questions  to  encourage  student  thinking  was  e  frequently 
used  strategy  by  all  instructors. 

g.  Units  varied  in  whether  cognitive  goals  were  stated  expli¬ 
citly  for  the  students.  Some  did  this  in  every  IE  class,  but 
most  did  not. 

h.  In  all  units  instructors,  took  time  to  sum  up  the  classroom 
activities. 

4.  The  effective  teaching  strategies  that  were  described  Included 
bridging  to  students'  or  instructors'  experlsnces,  explaining  the 
rationale  for  IE  training,  challenging  students,  getting  etudants  to 
ask  questions,  and  the  using  student  "experts"  to  answer  questions 
in  specific  knowledge  domains. 

5.  Bridging  in  Class 

a.  Typically,  instructors  presented  three  or  four  bridges  between 
cognitive  principles  and  applications  in  each  class.  A  few 
instructors  were  able  to  do  more. 

b.  Most  bridges  were  to  topics  related  to  the  personal  experiences 
of  students  rather  than  military  science.  And  there  was  little 
change  over  the  semester. 

c.  Instructors  tended  to  make  up  their  own  bridges  rather  than  use 
those  in  the  bridging  manual. 

d.  Instructors  believed  that  only  a  few  students  could  develop 
bridges  spontaneously. 

IE  Homework 


1.  Most  students  did  the  IE  homework  pages  regularly.  The  proportion 
who  did  not  varied  from  5  to  30  percent. 

2.  At  most  schools,  there  were  groups  of  students  who  did  homework 
together  (it  was  allowed). 

3.  At  most  schools,  some  students  did  unassigned  pages;  But  one  in¬ 
structor  commented  that  they  would  stop  when  things  got  too  hard. 


38 


Work.  Journal  (Wj) 


The  Work,  Journal  was  implemented  aa  designed  In  tha  aanaa  that  mn 
assignment  vat  glvau  lor  aach  IE  class  and  the  assignment  was  nedlatad  in 
sous  way.  For  all  instructors,  there  wars  class  presentations  of  journal 
entries  by  students.  Instructors  varied  in  tbs  extent  to  which  they  analysed 
and  gave  contents  on  tbe  written  entries.  They  also  varied  in  whet  they 
criticised  in  tha  journals;  a.g.,  clarity  o£  ideas,  grammar.  Instructors  with 
■any  students  had  a  difficult  tine  giving  detailed  feedback,  but  they  gave 
some.  Thus  tha  WJ  aspect  of  the  LEP  program  was  well  implemented,  especially 
given  the  constraints  on  instructor  time. 

Conducting  MS  Classes 

Instructors  varied  widely  in  the  extent  to  which  they  related;  tbe  IE 
classes  and  the  MS  classes.  Typically  tha  instructors  made  a  few  bridges 
between  IE  activities  and  MS  topics.  In  one  school,  however,  the  IE  and  MS 
topics  were  connected  by  relating  the  goals  of  etch  clash.  It  was  difficult 
under  the  tine  constraints  for  Instructors  to  make  many  1E-MS  connections. 

Discussion  of  Implementation  Quality 

Overall,  it  appears  that  the  instructors  did  an  excellent  job  of  imple¬ 
menting  IE,  especially  given  the  time  constraints.  All  the  major  program 
elements  were  instituted  conscientiously  and  even  creatively,  both  classwork 
and  homework.  Strong  areas  Included  the  encouragement  of  in-class  discus¬ 
sion,  use  of  Instructors'  questions  to  spark  thinking,  the  work  journal  pro¬ 
gram,  the  mediation  of  homework  in  class,  and  the  summarization  of  lessons 
learned  in  class. 

Implementation  was  more  spotty  with  respect  to  the  stating  of  cognitive 
goals  or  principles,  instructors  modeling  thinking,  end  bridging.  Instructors 
were  able  to  bring  in  only  a  few  bridges  per  dess.  Of  most  concern,  per¬ 
haps,  is  that  connections  to  the  MS  content  were  not  frequently  made.  In 
part,  this  was  probably  because  the  students  may  not  have  had  enough  military 
experience  to  provide  e  beaie  for  bridging. 

Tha  major  raason  for  waak  araaa  in  tha  lmpleuantation  is  undoubtedly 
time  conetreiuts.  Going  over  both  IE  and  WJ  homework  alone  should  normally 
taka  mors  than  half  a  pariod,  laaving  little  tine  for  other  in-class  activi¬ 
ties.  Another  factor  is  that  tbe  instructors  wsra  still  lasrning  the  tech¬ 
nique  end  undoubtedly  would  steadily  improve,  even  under  difficult 
conditions. 

These  weaker  areas  ere  described  as  an  aid  to  planning  future  work  end 
should  not  obscure  whet  wee  accomplished  end  the  tremendous  effort  of  the 
Instructors.  Moat  of  the  erees  of  spotty  implementation  ware  done  well  at 
some  units.  The  major  reason  for  variations  was  probably  that  soma  units  had 
mors  contact  hours.  With  axparlanca  and  tha  exchange  of  ideas  between  units, 
these  erase  would  be  more  uniformly  strong. 
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Our  methods  of  evaluation  were  generally  self-report,  with  the  exception 
of  the  sita  visits.  (Our  plans  for  site  visits  were  terminated  when  we  knew 
the  program  was  ending  after  one  year.)  But  the  conclusions  that  the  Impla¬ 
non  tatlon  was  above  the  minimum  specified  seams  warranted.  At  every  ROTC 
detachment,  there  were  signs  of  Instructor  commitment  and  creativity.  Exam¬ 
ples  include! 

(1)  Instructors  meeting  as  a  group  to  try  out  lessons 

(2)  Instructors  wearing  and  handing  out  lapel  buttons  that  aald  "Dare 
to  Think,"  and  so  on. 

Instructors1  Judgments  of  Program.  The  instructors'  overall  response  to 
the  program  was  quite  positive.  They  saw  the  value  of  cognitive  skills 
training  for  the  development  of  leaders. 

In-Class  Experience.  The  instructors  liked  the  interactive  teaching 
style  associated  with  IE  and  the  student  enthusiasm  that  resulted. 

Identifying  Prospective  Officers.  Instructors  felt  that  the  LEP  activi¬ 
ties  gave  tbtm  improved  insight  into  student  abilities  and  interests.  The  IE 
tasks,  class  interactions  and  Work  Journal  entries  helped  instructors  iden¬ 
tify  potential  officer  prospects. 

Perceived  Improvement  in  Student  Performance.  Instructors  perceived 
improvements  in  the  performance  of  students  in  the  following  areas. 

(1)  Writing-communication, 

(2)  Thinking  skills,  planning, 

(3)  Cognitive  styles  -  reduced  impulsiveness,  increased  precision, 

(4)  More  awareness  of  thought  processes  (meta-cognition) , 

(5)  Motivation. 

The  instructors  perceived  thec  a  solid  majority  of  the  students  thought 
positively  about  tha  program.  Interns tlngly,  they  reported  thee  the  students 
who  were  most  negative  about  the  program  were  the  students  that  needed  it  the 
moat;  that  is,  students  with  poor  tcadamlc  performance  and  motivation.  This 
parcaption  is  contestant  with  prior  work  on  teaching  learning  strategies 
(Collins,  Centner,  &  Rubin,  1983).  The  poorest  students  tsnd  to  show  the 
least  interest  in  learning  the  strategies. 

If  the  instructors'  perceptions  are  correct,  the  results  are  both  reas¬ 
suring  end  disturbing.  They  ere  reassuring  because  it  appears  that  e  high 
proportion  of  the  students  reacted  positively  to  the  LLP  program.  Theta  was  a 
concern  that  the  IE  teaks  were  too  easy  for  college  students,  and  aoma  good 
atudenta  did  feel  that  way.  But  moat  auch  atudants  found  ths  program  valua- 
bla  and  wara  vary  positive.  about  it. 
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The  die  Curbing  point  is  that  the  IE  program  is  designed  to  motivate 
students  with  low  self-concept  and  motivation.  And  in  fact,  instructors  did 
report  "spreading  enthusiasm,”  with  more  and  more  students  becoming  excited 
about  the  program.  Since  a  number  of  tbs  scboola  in  the  program  have  an 
open-enrollment  policy,  there  may  be  some  students  who  are  very  difficult  to 
motivate.  But  the  biggest  factor  may  be  the  low  number  of  IE  contact  hours 
and  the  distribution  of  IE  hours.  Typically,  students  would  get  IE  for  1 
hour  every  other  weak.  It  is  clear  that  these  are  difficult  conditions  for 
motivating  very  passive  students. 

Work  Journal.  The  instructors,  with  one  exception,  were  extremely  poel- 
tive  about  the  WJ«  It  was  generally  wall  received  by  students,  promoted 
class  discussion,  and  aided  learning  communication  and  thinking.  Several 
instructors  ware  able  to  employ  the  WJ  format  in  their  exams  as  essay 
questions.  Thus  the  skills  practiced  in  WJ  assignments  could  be  tested. 

Student  Tutoring.  The  ZE  materials  end  methods  were  sometimes  used  by 
instructors  for  special  out-oi-clesa  tutoring.  This  tutoring  sometimes  in¬ 
volved  students  who  were  not  in  the  LEP  program;  e.g.,  NS  III  students. 
Examples t 


1.  Some  Instructors  found  it  beneficial  to  tutor  MS  11  and  MS  Ill  stu¬ 
dents  in  Land  Navigation,  using  the  Orients tion-in-Spece  instru¬ 
ments.  These  instruments  gave  the  students  s  concsptusl  framework 
prior  to  outdoor  exercises. 

2.  One  instructor  prepared  some  students  for  the  Aviation  Branch  teat 
using  aome  IE  instruments.  The  students  scored  much  higher  then  is 
typical  for  the  school.  Of  course  we  can't  attribute  this  success 
to  IE  without  a  control  group  comparison.  But  it  is  an  example  of 
how  IE  was  percalvad  to  be  useful. 

Support  Material*.  Aa  mentioned  above,  the  instructors  liked  the  Work 
Journal  aspect  vary  much  end  they  found  the  WJ  support  materials  quite  ade¬ 
quate.  They  also  seemed  fairly  satisfied  with  the  Bridging  Manual.  Since 
they  tended  to  make  up  their  own  bridges,  this  manual  was  mainly  just  a  back¬ 
up. 


One  major  isaua  that  cams  up  la  that  the  Instructors  did  not  Ilka  having 
to  look  through  tha  lengthy  IE  teachers  guide  to  plan  their  lessons.  Several 
suggested  that  the  IE  training  instruments  be  prepared  with  fewer  pages,  to 
be  more  in  line  with  the  limited  classroom  hours.  Instructor  support 
materials  could  than  be  developed  to  correspond  to  tha  now  reduced  training 
materials. 

Self-Devolopment.  Instructors  identified  several  areas  where  the  train¬ 
ing  they  received  end  the  teaching  that  they  did  helped  their  own  develop¬ 
ment! 

1.  Teaching  in  e  more  interactive  way. 

2.  Interacting  better  with  students  outside  of  class. 


3.  Using  thinking  skills  more  effectively,  such  «s  planning  and 
organizing. 

4.  Changed  cognitive  styles;  less  impulsive  and  more  precise. 

5.  More  aware  of  own  thought  processes. 

6.  More  aware  of  the  critical  aspects  of  communication. 

Concerns 


Class  Tine.  The  major  concern  of  the  instructors  was  the  limited  amount 
of  classroom  hours  to  do  the  program  justice.  They  felt  that  they  could  not 
completely  follow  the  IE  teaching  modal  in  class  and  that  the  HE  topics  were 
also  being  undertaught. 

Distribution  of  LEP  Hours.  Many  instructors  felt  that  it  was  difficult 
to  main tain  the  momentum  of  student  enthusiasm  and  understanding  when  LEP  was 
taught  every  other  class  or  so.  Several  suggested  that  IE  be  front-loaded  in 
some  way;  e.g.,  start  with  6  weeks  of  IE.  In  that  way,  the  students  could  be 
brought  to  a  level  of  proficiency  that  could  be  built  on  in  later  training. 

There  are  several  possible  disadvantages  of  teaching  IE  in  big  blocks. 

1.  Me  do  not  know  the  effect  of  massed  vs.  distributed  practice  of  IE 
on  learning.  But  it  seems  reasonable  that  there  is  a  need  for  e 
considerable  amount  of  distributed  practice.  Ideally  one  would  have 
tha  option  of  some  massed  end  some  distributed  practice. 

l 

2.  By  front-loeding  IE,  there  is  no  subject  content  being  taught  in 
parallel  to  which  to  bridge.  Of  course,  tha  LEP  instructors  did  not 
do  much  bridging  to  military  applications.  But  in  principle,  wa 
wish  to  relate  thinking  and  communication  skills  to  laadarsbip  ac¬ 
tivities. 

3.  Students  enrolling  In  en  MS  course  might  be  put-off  by  a  solid  block 
oi  IE.  Thera  ware,  In  feet,  e  few  complaints  from  students  about 
the  noo-mllitary  nature  of  IE. 

All  in  all,  s  case  can  be  made  for  mass-practice  periods  of  IE  If  the 
above  concerns  can  bt  dealt  with.  Tha  main  problam  is  the  low  number  of 
available  classroom  hours  which  limits  tha  flexibility  in  distributing  hours. 
It  is  clear  that  the  aveileble  number  of  hours  is  much  smaller  than  is 
usually  recommended  and  that  tha  lna true  tors'  concerns  about  this  are 
juatlfiad. 

Preparation  Tima.  Tha  instructor!  alao  ate  ted  that  tha  LEP  program  took 
a  lot  of  their  out-of-claaa  time.  Part  of  the  problem  is  that  their  level  of 
other  dutlea  stayed  the  amme.  Another  factor  ia  that  many  of  tha  inatructora 
were  eo  conscientious  that  they  spontaneously  extended  the  use  of  IE;  e.g., 
tutoring.  To  some  extent,  this  problem  would  be  alleviated  in  later  years  as 
tha  instructors  gained  experience. 
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The  only  other  significant  concern  was  with  respect  to  the  development 
of  a  smaller  aet  of  materials.  This  issue  was  discussed  above. 

Despite  these  concerns,  the  instructors  were  quite  enthusiastic  about 
their  experiences  in  the  program  and  its  usefulness. 

Student  Response.  The  attitude  of  the  students  to  LEP  was  evaluated 
through  a  questionnaire  (Appendix  G)  which  contained  three  open-ended  ques¬ 
tions  and  twelve  "Likert"  Items.  One  factor  making  interpretation  of  results 
difficult  is  that  some  of  the  students  evaluated  the  MS  1  class  as  a  whole, 
not  just  the  IE  and  WJ  aspects.  But  the  comments  to  question  3  were  defi¬ 
nitely  focused  on  these  aspects. 

Over  1300  responses  ware  obtained,  and  the  results  have  not  yet  been 
tabulated.  But  random  samples  of  responses  have  been  examined.  Basically, 
the  results  were  consistent  with  the  perception  of  the  instructors. 

Students  ware  generally  positive  about  the  program  at  a  ratio  of  at 
least  3:1.  Positive  comments  were  with  respect  to  improved  cognitive 
skills,  awareness  of  own  thinking  improved  communication,  and  more  effective 
cognitive  styles.  Negative  comments  included  observations  that  IE  was  too 
easy  and  not  useful. 

These  comments  are  consistent  with  the  descriptions  by  instructors  of 
the  opinions  of  their  students.  The  Instructors  also  commented  that  many  of 
the  studunts  that  had  negative  reactions  to  IE  were  generally  poorly 
motivated  students. 

Observations  by  the  contractor's  representatives  who  conducted  the  sec¬ 
ond  semester  site  visits  indicated  that  almost  all  the  students  were  very 
positive  about  the  value  of  LEP. 

Therefore,  the  converging  evidence  is  that  students  generally  reacted 
positively  to  the  LEP  program. 

OUTCOME  AND  CONCLUSIONS 

Despite  the  promising  start  of  the  LEP  implementation,  the  program  bad 
to  be  canceled  after  one  year.  There  were  higher  priority  programs,  such  as 
the  ROTC  achievement  tasting  program,  that  needed  the  eame  resources  ea  LEP. 
The  uae  of  IE  in  ROTC  is  not  necessarily  ended  since  come  of  the  host  schools 
ara  including  IE  in  grant  proposals  for  programs  designsd  to  enhance  basic 
skills.  But  there  is  no  direct  follow-up  to  LEP  planned  in  the  near  future. 

Based  on  prior  research,  we  do  not  expect  any  eignificent  cognitive 
chaugea  after  only  e  13-hour-or-ao  implementation.  Thus  tht  major  valua  of 
this  projact  will  ba  aa  a  potantial  foundation  for  futura  cognitive  skills 
training  within  ROTC. 


The  following  conclusions  seemed  warranted. 

1.  Cognitive  skills  training  can  be  integrated  into  ROl'C  programs. 

2.  Instructors  and  students  generally  see  the  relevance  and  value  of 
cognitive  skill  training. 

3.  The  fact  that  some  instructors  spontaneously  used  IE  materials  for 
special  tutoring  indicates  a  need  in  ROTC  for  some  abstract  training 
materials  for  some  topics;  *.g.„  Land  Navigation. 

4.  ROTC  instructors  are  capable  of  creatively  implementing  a  cognitive 
skills  training  program. 

5.  Writing  assignments  can  complement  teaching  MS  topics  and  cognitive 
skills  training. 

6.  Programs  that  require  cognitive  activity  on  the  part  of  students, 
s.g.,  IE  exercises,  can  aid  the  identification  of  potential  offi¬ 
cers. 

7.  Instructors  respond  well  to  using  an  interactive  style  of  teaching. 

8.  The  biggest  difficulty  in  inserting  a  special  program  into  ROTC  is 
the  limited  number  of  classroom  hours. 

The  best  approach  may  be  a  combined  program  between  ROTC  and  tha  host 
schools.  ROTC  could  help  fund  such  programs  and  tha  schools  could  provlda 
othsr  rssourcss  such  as  Instructors  and  class  timt. 
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APPENDIX  A 


ROTC  DETACHMENTS  THAT  TOOK  PART 
IN  THE  LEP  PROJECT 


This  appendix  contains  those  schools  that  actually  took  part  in  the 
LEP  project.  For  the  original  set  of  schools  selected  plus  additions  and 
deletions  (see  page  B-8  In  the  Appendix  B) . 
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ROTC  DETACHMENTS  THAT  TOOK  PART  IN  THE  LEADERSHIP 
ENRICHMENT  PROJECT  (1984-1985) 


EXPERIMENTAL*  (LEP)  CONTROL* 


FIRST  ROTC  REGION 
Florida  A&M 

Fort  Valley  State  (Georgia) 

Hampton  Institute  (Virginia) 

Howard  University  (District  of  Columbia) 
North  Carolina  A&T 

St  Augustine  College  (North  Carolina) 

St  Peter's  College  (New  Jersey) 

Virginia  State 


FIRST  ROTC  REGION 

Morgan  State  (Maryland) 
Norfolk  State  (Virginia) 
South  Carolina  State 
Widener  (Pennsylvania) 


THIRD  ROTC  REGION 

Alcorn  State  (Mississippi) 
Jackson  State  (Mississippi) 
Southern  University  and 
A&M  College  (Louisiana) 
Stephen  F.  Austin  (Texas) 
Tuskeegea  Institute  (Alabama) 
University  of  Central  Arkansas 
University  of  Arkansas  at 
Pine-Bluff 


THIRD  ROTC  REGION 
Alabama  A&M 

Henderson  State  (Arkansas) 
Nicholls  State  (Louisiana) 
University  of  North  Alabama 
Prairie  View  A&M  (Texas) 


*8tate  where  school  is  located  is  given  if  not  obvious 
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"LEP  Implementation" 


Description 


Pages 


Letter  from  ODCSROTC  MG  Priilamsn  Setting  Up  LEP.  .....  B-2 

Implementation 

LEP  Course  Outline. . . . . . B-5 


Example  of  MS  1  Course  Outline  with  Suggested  IE  Pages.  .  .  B-6 

Original  Set  of  Schools  Selected  with  those  dropped  ....  B-8 

indicated  by  (DELETE) {  those  added  indicated  by  (ADD). 

Note  University  of  Arkansas,  Pine  Bluff  went  from  the 
control  to  experimental  group. 


Original  LEP  Milestones  as  of  date  of  letter 
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DEPARTMENT  OF  THE  ARMY 

MEADOUAf TCAl  UNITS*  ITlTCt  AKWT  TNaiNINB  AND  BOCTAINC  CDKM.4HD 

rowt  mcnmoc,  vmstNi*  tint 

Office  of  the  Deputy  Chief  of  Staff  for  ROTC 


•int  n 


.  ATAO-TA 


5 1  ‘MT  138-j 


SUBJECT:  Implementation  of  the  Leadership  Enrichment  Program  (LEP) 

•  "  (Formerly  called  Instrumental  Enrichment)  SY  84-B5-SY  86-87 


Commander,  US  Army  First  ROTC  Region,  Fort  Bragg,  NC  28307 
Commander,  US  Army  Third  ROTC  Region,  Fort  Riley,  KS  66442 


1.  Reference:. 

a.  Letter,  ATRO-EE,  HQ  TRADOC,  20  March  19B4,  subject:  Instrumental 
Enrichment  (IE)  Phase  II  Pilot  Project  SY  84-85  and  SY  85-B6. 

b.  Message,  HQ  TRADOC,  ATRO-EE,  091002  Apr  84,  subject:  Instrumental 
Enrichment  (IE)  Project  -  Professor  of  Military  Science  (PMS)  Training  Session, 
24  Apr'il  1964. 

*  .  i 

c.  Professor  of  Military.  Science  (PKS)  Training  Session,  held  at  US  Amy 
Research  Institute  for  the  Behavioral  and  Social  Sciences  (AP.l),  24  April  1964. 

2.  Per  references,  the  Leadership  Enrichment  Program  (LEP)  will  be -implemented 
into  the  Basic  Course  curriculums  of  LEP  experimental  schools  beginning  SY  84- 
£5.  Overall,  the  LEP  will  be  implemented  in  three  phases: 

e.  Phase  1  (SY  84-85)  will  affect  experimental  schools  only.  Phase  1  will 
incorporate  LEP  into  the  first  year  of  the  4-yeer  Senior  ROTC  program  and  will 
begin  the  fell  term,‘SY  84-85.  Course  outlines  for  the  Basic  Course  ere 
provided  at  Enclosure  1.*  A  detailed  MS  I  course  outline  is  at  Enclosure  2. 

b.  Phase  II  (SY  85-B5)  will  affect  experimental  and  control  schools.  For 
Phase  11,  LEP  will  be  incorporated  into  the  first  year  of  the  4-year  Senior 
ROTC  program  at  all  schools  and  in  the  second  year  at  all  experimental 
schools.  A  detailed  MS  11  course  outline  will  be  provided  prior  to  SY  85-86. 

c.  Phase  III  (SY  86-87)  will  affect  experimentel  and  control  schools. 

Phest  II  will,  Incorporate  LEP  into  the  entire  Basic  Course  and  will  begin  fall 
semester,  SY  85-87. 

3.  The  goal  of  implementing  LEP  into  the  Basic  Course  is  to  improve  cadet 
leadership  skills,  specifically  those  required  for  problem  analysis  and 
decision  making.  This  will  be  accomplished  by  incorporating  LEP  throughout  the 
entire  Basic  Course  at  designated  experimental  schools  and  comparing  these 
schools  to  a  group  of  designated  control  schools  (reference  a).  To  support 
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‘ATRO-TA 

.SUBJECT:  implementation  of  the  Leadership  Enrichment  Program  ( LEP ) 

(Formerly  called  Instrumental  Enrichment  SY  8^ -85- SY  86-B7 

this  goal  the  standardized  Basic  Course  curriculms  provided  at  Enclosures  1  and 
2  have  been  developed.  A  final  list  of  experimental  and  control  Schools  is 
at  Enclosure  3.  Each  school  should  designate  a  primary  POC  for  this  project 
and  forward  POC  name  and  phone  number  to  the  appropriate  Region  POC. with  copy 
•furnished  to  ATRO-TA,  Fort  Monroe,  YA,  not  later  than  29  June  1984. 

4.  A  training  course  for  the  MS  I  LEP  instructors  and  Region  POC's  will  be 
conducted  1-10  August  1984,  per  reference  a.  A  site  for  this  course  will  be 
announced  shortly.  Regions  will  provide  travel  funds  for  this  course. 

Additional  instructor  training  courses  will.be  conducted  in  August  1985  and 
August  1986.  Note  that  all  MS  !  Instructors  from  the  experimental  schools  are 
required  to  attend  the  August  Instructor  training  course  In  1984.  This 
training  requirement  does  not  affect  control  school  instructors.  Regions  may 
send  experimental  school  PKS  to  the  instructor  training  course  based  on 
expressed  interest  and  availability  of  resources. 

5.  A  LEP  Training  Support  Package  which  includes  lesson  plans  is  being 
developed  and  will  be  distributed  at  the  instructor  training  course  to  be  held 
in  August. 

■ 

6.  ' Fc r  research  purposes,  Basic  Course  KQS  1  subjects  must  be  taught 
sequentially  in  a  designated  semester  as* will  LEP  tasks.  During  the  first  year 
of  the  Basic  Course,  a  minimum  of  15  hours  of  LEP  will  be  taught  (Enclosure 

1).  This  instruction  will  be  Incorporated  throughout  the  school  year,  not  just 
at  the  beginning,  end,  or  in  spurns.  LEP  subjects  in  some  cases  may  not 
correlate  directly  with  the  KQS  subjects  being  taught.  The  LEP  is  designed  to 
cover  all  facets  of  problem  solving  and  decision  making  over  the  length  of  the 
Easi:  Course.  There  are  some  required  Basic  Course  MQS,  I  tasks  thet  have  not 
been  specified  to  be  taught  during  any  particular  semester.  Professors  cf 
Military  Science  have  the  flexibility  tc  designate  when  they  want  to  teach 
these  subjects  in  the  Basic  Course. 

7.  Homework  assignments  and  student  work  journals  are  integral  parts  of  the 
program.  These  items  are  to  increase  the  value  of  lessons  learned  in  the 
classroom  and  for  the  cadet  and  the  cadre  to  provide  students  with  valuable 
feedback  on  their  writing  end  cormu/ni  cations  skills.  Homework  and  journals 
should  be  a  part  of  the  course  grade  in  addition  to  class  participation  and 

•"  KQS  subject  knowledge.  Required  homework  assignments  will  be  specified  in  LEP 
training  support  packages. 

"  B.  The  AR1  will  provide  test  support  to  document  program  progress.  This  will 
be  accomplished  with  a  pretest  at  the  beginning  of  the  fall  semester  and  by  a 
posttest  at  the  end  of  the  spring  semester.  Time  for  these  tests  has  been 
built  into  the  course  outline  for  the  Basic  Course  (Enclosure  2).  Arrangements 
for  test  administrations  by  ARI  personnel  are  to  be  coordinated  between  AR1 
scientists,  Region  POC,  and  individual  schools.  Regions  may  authorize  schools 
direct  contact  with  ARI  as  desired. 
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SUBJECT:  Implementation  of  the  Leadership  Enrichment  Program  (LtP) 

(Formerly  called  Instrumental  Enrichment  SY  84-85- SY  86-87 

9.  This  headquarters  recognizes  that  the  experimental  schools  may  have 
difficulty  implementing  this  program  and  realigning  I’QS  subjects  in  the  time 
remaining  prior  to  the  beginning  of  SY  84-85.  However,  the  benefits  gained  by 
starting  the  program  in  SY  84-8o  far  outweigh  these  difficulties.  Per 
reference  c,  experimental  schools  will  implement  the  program  as  outlined. 
Request  Region  POC  verify  those  experimental  schools  who  are  able  and  unable  to 
meet  this  requirement  for  SY  84-85  and  reply  to  this  hetdquarters,  ATTN:  ATP.D- 
TA,  stating  their  reason  for  noncompliance.  Response  to  this  tasking  »,*ould  be 
appreciated  by  15  June  1984,  but  in  any  case  must  be  provided  not  later  than 

2  July  1984. 

10.  A  list  of  near-term  project  milestones  is  provided  at  Enclosure  4. 

11.  Point  of  contact  at  ODCSROTC  is  Kr.  Stephen  Prelewicz.  AUTOYON  680- 
3826.  US  Army  Institute  for  the  Behavioral  and  Social  Sciences  points  of 
contact  are  Dr.  Carlos  Rigby  and  Dr.  Paul  Twohig,  AUTDYOM  284-8253. 


(e)  PRILLAMAN 

4  Enel  '  JOHN  P.  PRILLAMAN 

as  Major  General,  GS 

Deputy  Chief  of  Staff  for  RDTC 


CF: 

Cdr,  2R3TCR 
Cdr,  AT.OTCR 
Cdr,  USAR1BSS 
(ATT!.':  Dr.  Saveli) 


LEP  COURSE  OUTLINE  FOR  BASIC  COURSE  PHASE  I  (ST  84-85) 
THROUGH  PHASE  III  < SY  86-87) 


1.  MS  1  -  1st  Semester 

a.  Customs  and  Traditions  (Task  #  3) 

b.  Organization  of  U.S.  Arrry  (Task  #9) 

c.  Role  of  U.  S.  Amy,  United  States  Amy  Reserves,  end  National 

Guard  (Task  #'s  6,  7,  8) 

d.  Physical  Readiness  (Task  #47) 

e.  .LEP  (Mininum  of  8  hours  which  includes  Pretest 

(1)  Pretest  •  (1  hour) 

(2)  Instructions  (2  h6urs) 

(3)  Comparisons/Classifications  (3  hours) 

(.4)  Orientation  in  Space  I  (2  hours) 

• 

2.  MS  I  -  2d  Semester 

a.  Land  Navigation  (Task  #  24} 

b.  LEP  (minimum  of  7  hours  which  includes  a  Posttest) 

,  (1)  Orientation  In  Space  III  (2  hours) 

(2)  Organization  of  Dots  ,  (2  hours)  ' 

(.3).  .Analytical  Perception  (2  hours) 

3.  MS  II  -  1st  Semester 

♦  •  •  • 

a.  Leadership  (Task  #  1) 

b.  LEP  (Required  hours  to  be  determined) 

4.  KS  II  -  2d  Semester 

a.  First  aid  (Task  #s  29-36  and  41-44) 

b.  LEP  (Required  hours  to  be  determined) 

5.  Kcn-specified  tasks  (MQS  I  tasks  which  must  be  given  during  MS  I  or  MS  II 

school  year) 

a.  Conduct  an  Inspection  (Task  I  1) 

b.  Drill  and  Ceremony  (Task  #  2) 

c.  Principles  of  War  (Task  #  4) 

d.  Branches  of  the  Amy  (Task  #  10) 
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LEADERSHIP  ENRICHMENT  PROGRAM  (LEP) 

IMPLEMENTATION 

• 

Example 

of  MS  I  Course  Outline 

MS  1  (1st  Semester) 

. 

* 

Class 

Session 

MQS  Subject 

LEP  Exercise 

LEP  Exercise  Pages 

In  Class  Homework 

1 

In  process 

2 

Pretest 

3 

Instructions 

C,  3,  4,  6-8 

5,  9-14 

4 

• 

Instructions 

15,  21,  24 

25-26 

S 

Customs  and 
Traditions 

■ 

» 

6 

• 

• 

Comparisons 

1,  9,  12 

2-3,  8, 

14-20. 

7 

• 

Classification 

• 

l.  2,  5, 

7-8,  11-12 

3-4,6.  9, 

16-18 

• 

8' 

Organization  of 
the  Army 

>  •  • 

•  * 

9 

Classification 

21-24 

28-31 

10 

Role  of  US  Arirty , 
USAR,  end  NG 

11 

Orientation  in 
Space  I 

1.  3,  6 

7-9 

12 

Role  of  US  Ariry , 
USAR,  and  NG 

13 

14 

Role  of  US  Anry, 
USAR,  and  NG 

Orientation  in 
Space  1 

11,  12,  16 

13-15 

15 

Physical  Training 

■ 

• 

16 

Final  Period  Exam 

■  •  . .  •-*- 

. .  • 

_  m 

'  ^«S  I .  ( 2d  Semester  1 
Class 

ilUiSil  MQS  Subject  LEP  Exercise 

1  In  Process 

2  Land  Navigation 

3  Orientation  in 

Space  III 

*  Orientation  in 

Space  III 


5 

6 

7 

B 

S* 

10 

11 

12 


Land  navigation 
Land  Navigation 

Organization  of 
Dots 

Organization  of 
Dots  * 

Land  Navigation 
Land  Navigation  *  * 

Analytic 

Perception 

Analytic 
Perception  ' 


13  Land  Navigation 

14  Land  Navigation 

15  Posttest 


LEP  Exercise  Pages 
In  Class  Homework 


C,  1,  3-4 
6-7,  8b, 

9,  13 

2 «  5 ,  8 ,  10 
10-12 

Part  IS, 
17,  19-21 

Rest  15 

16.  18, 
22-24 

1.  8 

« 

2,  5.  10-11 

17,  B5 

17-20,  El, 
B6  . 

C,  1,  3, 

5,  9-11 

•  » 

2,  4,  6-8 

10,  12-13 

14,  19,  25 

29  ,  34  •  " 

15,  17, 
20-21, 

26-2E , 

35-33 

Final  Period-Exam 
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ROIC  DETACHMENTS  SELECTED  FOR  INSTRUMENTAL  ENRICHMENT  TRAINING 
SY  84-85  THROUGH  SY  86-87 


EXPERIMENTAL 

FIRST  ROTC  REGION 

Augusta  College 
Morgan  State 
Norfolk  State 
South  Carolina  State 
Widener 


THIRD  ROTC  REGION 

Alcorn  State 
Central  State 
Jackson  State 
Southern  University  and 
ASM  College 
Stephen  F.  Austin 
Tuskeegee  Institute 
University  of  Central  Arkansas 
University  of  Mississippi  (DELETE) 
University  of  Arkansas  at 
Pine-Bluff)  (ADD) 


CONTROL 

FIRST  ROTC  REGION 

.Florida  A&M 
Fort  Valley  State 
Hampton  Institute 
Howard  University  (ADD) 
North  Carolina  AST 
St  Augustine  College 
St  Peter’s  College 
Virginia  State  (ADD) 


THIRD  ROTC  REGION  ‘ 

Alabama  ASM 

Auburn  University  (DELETE) 
Henderson  State  .  . 

Nicholls  State 
University  of  North  Alabair* 
Prairie  View  ASM 
University,  of  Arkansas  at 
Pine  B 1  of -f 
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LEP  MILESTONES 


DATE 

AGENCY 

ACTION  TO  BE  TAKEN 

1  Jun  B4 

TRADOC 

• 

Provide  contractor, purchase  request  for 
LEP  material 

1  Aug  84 

ARI 

Deliver  Pretest  material  to  ROTC 
Detachments 

MO  Aug'  84 

Contractor 

Conduct  instructor  training 

Deliver  instructor  support  package 

» 

6  Aug  64 

Contractor 

Deliver  student  LEP  materials  to  P.OTC 
Detachments 

15  Aug  84 

Experimental 

Detachments 

Confirm  receipt  of  LEP  materials  to 
Region  HQ 

Aug/Sep  64 

Experimental 

Detachments 

Implement  LEP  in  MS  1 

Aug  £5 

,  Contractor 

Conduct  instructor  training 

Deliver  instructor  support  package 
Deliver  student  LEP'  materials  to  ROTC 
Detachments 

Aug/Sep  85 

Experimental  and' 
Control  Detachments 

Implement  LEP  MS  I  Basic  Course 
Curriculums  (AIL) 

Implement  revised  KS  I  Basic  Course 
curriculum  (Experimental), 

Aug  85 

Contractor 

Conduct  instructor  training 

Deliver  instructor  support  package 
Deliver  student  LEP  materials  to  P.OTC 
Detachments 

Aug/Sep  86 

Experimental 
and  Control 
Detachments 

Implement  LEP  MS  II  Basic  Course 
Curriculums  (ALL) 
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LEP  Bridging  Manual 


Appendix  C  contains  sample  pages  from  the  Bridging  Manual  (BM).  The 
sample  pages  are  with  respect  to  the  IE  instrument  "Instructions."  There 
were  similar  pages  for  all  the  instruments  taught  in  MS  I  in  the  full  manual. 

The  first  three  pages  {C-2  to  C-4)  contain  lists  of  bridging  ideas  from 
Instructions  for  several  of  the  Military  Service  (MS)  topics.  There  ate 
bridges  to  more  topics  in  the  complete  manual. 

The  next  section  (C-5  to  C-7)  contains  the  model  lesBon  plan  for  teach¬ 
ing  a  lesson  on  Instructions  which  Instructors  could  follow  or  dispense  with 
at  their  discretion. 

The  next  section  (08  to  C-9)  shows  bridges  in  the  opposite  direction 
from  that  described  above:  from  a  MS  topic  (Customs  and  Traditions)  to  an  IE 
Instrument  (Instructions).  The  complete  manual  had  bridges  from  each  uni¬ 
tary  subject  to  a  variety  of  instruments. 


INSTRUCTIONS 

(From  Bridging  Manual  Section  1) 

Applications  or  Bridging  Suggestions  to  be  Incorporated  In  Lessons 


Roles  of  Army  Reserves,  and  National  Guard 

Bridge  A,  Contrast  the  roles  of  the  three  components  (Army,  Reserves, 

National  Guard)  on  the  criterion  of  type  of  service  rendered  to 
the  nation. 

(Collecting  all  the  data;  using  the  data  for  comparisons) 

Bridge  B.  Write  a  description  of  your  advice  to  a  high  school  drop  out,  a 

high  school  graduate,  and  a  college  graduate  as  to  which  to  the  three 
components  is  most  appropriate  for  service. 

(Relating  instructions  to  context  and  tot  he  needs  of  the 
direction  follower) 


Bridge  C.  Describes  precisely  how  one  enlists  in  the  ROTC. 

(Creating  precise  instructions) 


Bridge  D.  Critique  a  written  description  provided  by  the  Army  for  the  stops 
involved  when  enlisting  in  the  National  Guard,  ROTC,  and  the 
and  the  regular  Army.  Use  what  you  know  about  the  functions  of 
component! . 


(Critiquing  instructions  given  by  others) 


Bridge  £.  Compare  the  directions  found  in  Bridge  D  (above)  for  similarities 
and  difference. 

(Directions  may  be  similar  but  not  exactly  the  same) 


Bridge  F.  Describe  at  leest  three  unique  feutrures  of  each  of  the  three 
components,  as  if  you  were  speaking  to  high  school  senior. 

(Oele«.tion  -of  relevant  data  for  the  needs  of  the  direction 
follower) 
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INSTRUCTIONS 


Applications  or  Bridging  Suggestions  to  be  Incorporated  In  Lesson 


Establish  Physical  Readiness  Program 

Bridge  A.  Identifying  two  instructions  during  physical  training  which  are 
similar  but  not  identical. 

(Instructions  may  be  similar  but  not  exactly  the  same) 

Bridge  B.  Relating  instructions  to  personal  appearance  within  physical 

training;  name  three  aspects  of  personal  appearance  of  an  officer 
which  result  from  instruction  by  a  leader. 

(Inatructiona  lead  to  specific  results) 

Bridge  C.  Looking  around  the  room,  identify  three  instructions  which  could 
be  created  to  improve  the  appearance  of  the  students  in  the  room. 

(Creating  instructions  to  produce  a  desired  result) 


Bridge  D.  Analyzing  the  directions  given  by  the  physical  training  instructor 
for  a  specific  exercise  and  Identifying  where  they  could  have  been 
strengthened. 

(Critiquing  instructions  for  improvement) 

Bridge  E.  Identifying  those  specific  places  during  physical  training  where  a 
point  of  view  is  important  in  giving  and  following  instructions 
particularly  In  areas  relating  to  right  and  left  directions. 

(Involving  poict  of  view  in  following  and  giving  instructions) 
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INSTRUCTIONS 


Application  oc  Bridging  Suggestion*  to  be  Incorporated  in  Lessons 
Land  Navigation 

Bridge  A.  Following  given  instructions  to  go  precisely  from  point  to  point 
on  a  land  map. 

(Precision  in  following  instructions) 

Bridge  B.  Creating  precise  instructions  to  help  another  person  to  go  from 
point  to  point  using  a  land  map. 

(Invention  of  instructions  which  are  precise  and  sequential) 

Bridge  C.  Following  instructions  carefully  in  the  une  of  s  lenSatic  campasa. 

(Precision  in  following  given  instructions) 

Bridge  D.  Collection  of  all  relevant  data  on  map  before  getting  to  follow 
the  route 

(Completeness  in  data  collection  before  loginning  to  solve  the 
problem  . 

Bridge  E.  Looking  carefully  at  e  map  created  by  another  person  and 
critiquing  that  iu  regard  to  which  informa tion  ia  missing. 

(Analyzing  instructions  for  missing  information) 

Bridge  F.  Orienting  a  land  map  correctly  before  beginning  to  use  it. 

(Making  certain  to  get  the  first  instruction  correct 
before  following  the  next  in  the  sequence). 
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MODEL  LESSON  PLAN  FOR  INSTRUCTIONS 


Objective:  Students  will  percisely  follow  the  given  instructions,  without 
being  confused  by  the  change  in  directions. 


Students  will  correctly  apply  the  concept  of  size  order  to  the 
execise  on  the  page. 


Materials:  Instrictlona  Instrument,  page  IS. 

Refer  to  Teacher's  Guide  for  Instructions,  page  32  for 
In (reduction  to  this  page. 


Time:  Introduction,  5  minutes 

Pag:  solution,  IS  minutes 
Chr, eking  solution,  10  minutes 

Discussion  for  insight  and  bridging  activities,  20  minutes 
Total:  SO  minutes 


Secuence  c_£  Activities: 

1.  Ask  students  to  summarize  the  principles  they  have  learned  thus 

far  about  following  instructions  (read  carefully,  plan  response, 
check  response  against  original  instructions,  etc.) 

2  Without  further  discussion,  distribute  copies  of  page  IS  to  students, 
asking  them  to  apply  these  principles  in  following  the  instructions 
on  this  page. 

.3.  Nome  students  will  inevitably  continue  correcting  the  pictures  on  the 
entire  page,  although  the  same  instructions  ont  he  right  side  shift  to 
correcting  the  instructions.  Ask  those  who  discover  their  error 
not  to  communicate  this  pitfall  to  others  so  that  all  students  in 
this  situation  can  discover  their  own  impulsiveness. 

4.  Ask  pair  of  students  to  check  each  other's  work.  Thus,  more  students 
who  have  incorrectly  followed  the  instructions  on  the  second  half  of 
the  page  will  discover  their  impulsiveness. 

Note:  Pairs  of  students,  who  finish  end  check  each  other's  work 
while  others  are  still  working,  may  benafit  from  thslr  own 
problem  frames  and  testing  each  other  on  them. 
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5.  In  large  group  discussion!  ask  students  to  share  with  the  group  what  they 
would  Identify  as  the  "trickiest"  part  of  this  page — the  shift  in  the 
Instructions.  Discuss  why  people  tend  too  fall  into  this  "trap."  (We 
are  expecting  the  sane  Instructions  to  continue;  this  is  the  first  page 
where  instructions  shift;  acting  too  quickly). 
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MODEL  LESSON  PLAN  POR  INSTRUCTIONS 


Sequence  of  Activities  (cont.)t 

6.  Agk  itudtnts  to  compare  this  page  with  5  to  confirm  the  aioilarity  of 
layout,  but  the  difference  in  the  instructions. 

7.  In  discussing  the  answers  to  the  right  side  of  the  page,  ask  the 
students  why,  in  frame  2,  row  2,  it  is  unnecessary  to  write  that  the  smalleat 
circle  is  in  the  middle  (The  corrected  instructions  say  that  the  circles  will 
not  be  drawn  according  to  size,  and  that  the  biggest  circle  is  on  top  --thus, 
by  inference,  we  know  that  the  smallest  circle  must  be  in  tbe  middle.) 

Note:  Further  discussion  about  the  concept  of  size  order  can  take  place  in 

conjunction  with  Comparisons  Instrument,  page  21,  where  the  concept  of 
rank  order  is  the  subject. 

8.  In  bridging,  ask  students  to  compare  the  experience  on  this  page  with 
the  experience  of  receiving  a  written  set  of  orders  from  a  field 
commander  during  a  field  exercise;  the  orders  require  your  company  to 
move  as  a  unit  around  the  left  flank  of  the  enemy  to  a  prescribed 
position  and  provide  .multiple  cues  for  land  navigating  to  that 
objective. 

The  unit  moves  successfully  to  that  objective. 

On  the  following  day,  the  company  receives  a  similar  sat  of  orders, 
but  this  time  requiring  the  company  to  move  to  an  objective  which 
involves  moving  around  the  right  flank  of  the  enemy.  This  time,  the 
company  commander  expects  the  directions  of  movement  to  be  the  same, 
because  all  of  the  other  sequences  in  the  move  are  similar,  and  the 
cues  to  be  used  in  the  navigation  are  similar. 

However,  this  companu  will  at  best  be  in  the  wrong  place,  and  at 
worst  be  annihilated  by  the  enemy  because  the  direction-follower 
had  a  "mind-set"  expecting  all  instructions  to  be  the  same,  since  the 
general  layout  and  appearanca  of  both  tasks  were  the  same. 


9.  Ask  studsnts  to  shara  one  incident  from  their  own  personal  lives  in 
which  all  except  one  aspect  of  a  written  instruction  was  the  same  as  a 
previous  set,  resulting  in  an  error  in  direction-following. 


Evaluation! 

1.  Accuracy  of  students  in  following  instructions  on  page  15. 

2.  Relevance  of  student  comments  in  identification  of  the  challenging 
parts  of  this  page. 
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3.  Breadth  and  relevance  of  atudant  bridging  suggestions  in  both 
military  (no. 8)  and  personal  (nop. 9)  applications,  as  described 
in  this  Lesson  Plan 
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MODEL  LESSON  PLAN  FOR  INSTRUCTION 


Homework i 

1.  Assign  pages  25-26  in  Instructions. 

2,.  Assign  pages  21  &  24  in  Instruction’s,  If  not  completed  in  class. 
3.  Assign  Work  Journal  Topic  02  on  Implied t/Expliclt  Ins  true tlona . 
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CUSTOMS  AND  TRADITIONS 


WITH  APPLICATIONS  AND  BRIDGING  SUGGESTIONS 

RELATED  TO 

COGNITIVE  SKILL  DEVELOPMENT 
(PROM  BRIDGING  MANUAL  SECTION  3) 
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CUSTOMS  AMD  TRADITIONS 


i 

l 


Applications  or  Bridging  Suggestions  to  be  Incorporated  in  Lessons 


Instructions 

Bridge  A.  Correctly  following  instructions  of  a  unit  commander  in  a  drill 
ceremony. 

(Following  instructions  correctly  according  to  a  prescribed 
sequence) 

Bridge  B.  Creating  Instructions  for  a  unit  leader  under  you  command  in  a 
drill  ceremony. 

(Investing  instructions  which  will  produce  precisely  the 
desired  result) 

Bridge  C,  using  Military  Leadership  (FM-100),  analyze  an  example  from 
military  history  where  success  in  battle  was  dut  to  the  clear  and  precise 
instructions  of  a  leader 

(Importance  of  clear  and  precise  instructions) 

bridge  D.  Using  the  same  manual)  identify  one  example  fro  military  history 
of  failure  in  battle  which  was  due  to  the  lack  of  complete  instructions  given 
by  the  leader  during  battle. 

(Importance  of  completeness  in  instructions) 

Bridge  E.  List  the  qualities  of  a  leader  which  relate  to  the  giving  of 
instructions. 

(Clarity  of  wording,  percislon,  proper  sequence,  and 
completeness  as  characteristics  of  appropriate  instructions) 

Bridge  F.  Plan  a  pass  in  review  ceremony  for  e  change  of  commend  which  can 
be  accomplished  in  30  minutes. 

(Planning  the  entire  task,  anticipating  outcomes  from  given 
Instructions) 

*  For  use  with  Model  Lesson  Plan  for  Instructions  on  Pages  10-12 
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APPENDIX  D 


LTC  Robert  Del  ton  (PUS) 
CPT  Jamea  Otto 
CPT  Ernest  Starks 


CPT  King  Cooper 
CPT  Lllllen  Smith 
MSG  Ralph  Mackey 


South  Carolina  State 


CPT  Cornell  Richardson 
CPT  James  Archer 
CPT  Levern  Bethea 


Alcorn  State 


MAJ  John  Kelly 
CPT  John  Quigley* 
SG  Rufus  Smith 


S.F.  Austin 


LTC  Paul  Kellerhals  (PMS) 
MAJ  Richard  Clark 


Tuskeegee  Inst 


CPT  William  Adams 
SG  Bobby  McBride 


Jackson  State 


CPT  Michael  Smith 
CPT  Eugene  Payton 
CPT  Richard  Segraa 
SG  Paula  Stuckey 


Southern  A&M 


MAJ  William  Wolfe* 

Morgen  State 
MAJ  Errol  Pratt 


Central  Arkansas 
MAJ  Daniel  Brittain 


Widener 

CPT  Jamea  Robert  Hibbard 


Also  attending  were  Region  POCs 
REGION  Ii  CPT  Ira  Watkins 
REGION  III:  CPT  Michael  Koralevlch 


*  Did  not  take  part  In  LEP 


_Make  up  Training.  February  1985,  3  Days 


Alcorn  State 
CPT  Arthur  Mar tin 
SGM  David  Lambert 
SG  Gaorge  Chandler 


Southern  A&H 


CPT  Janes  Ball 
CPT  William  Jones 
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appendix  e 


Basic  Class  Record 


ins  true  tarii**  ,!.conuln*  th*  ®*,lc  C1*,#  R#cord  which  was  filled  out  by 

?'  *°  d0CUB,nt  *•  -ctual  MS  and 

*E  topics  caught  and  associatsd  information,  a.g.  homework. 
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LEP  PROGRAM 


Baale  Class  Record 

School _ Instructor _  Section 

Session  IE  or  MS  Subject  IE  Pages 


In  Class 


Homework 


Pag*  2 


Session 


Goal-Cognltlv*  Principles 


Work  Journal  Asalsgmnent 
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APPENDIX  F 


LEP  Instructor  Insights  Qusstionnslre 


In  contrast  to  tha  Basic  Cists  Record  (Appendix  E),  this  question^ 
naire  calls  for  nor*  detailed  responses  from  the  instructors  on  the  LEP 
project. 
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LEP  Instructor  Insights  Questionnaire 


Essie  Information 

School: _ _____________ 

Instructor  Kane:  _ __________________________________ 

Give  the  following  information  for  your  LEP/HS  sections: 

« 

End  of  Semester  Is  it  in  a 

Section  Number  Class  Site  Cross-Enrolled  School? 


List  other  courses  that  you  taught,  including  labs. 


Ins  true  Cions 


Please  answer  the  following  questions  on  separate  sheets  and  place  the 
question  number  by  each  answer.  If  your  answers  are  handwritten,  please 
write  as  clearly  as  you  can.  The  questionnaire  is  organized  by  sections  and 
you  may  wish  to  read  through  it  first  to  get  a  picture  of  what  is  asked.  You 
will  get  a  chance  to  add  comments  beyond  your  answers  to  the  questions. 
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Questions 


A.  Preparing  for  IE  Clastic 

For  the  questions  in  this  section  describe  your  typical  experience  in 
preparing  for  an  IE  class.  Also,  Indicate  whether  anything  changed  over  the 
course  of  the  senes  ter. 

1.  How  nuch  tine  did  you  usually  spend  preparing  for  an  IE  class? 

2.  Did  you  work  with  others  in  preparing  for  IE  classes?  If  so,  in 
what  way? 

3.  11  you  taught  sore  than  1  section,  how  did  you  use  the  experience 
of  teaching  one  section  affect  how  you  planned  and  taught  other 
aectlons? 

4.  Describe  how  you  used  the  following  support  materials.  Indicate 
the  good  and  bad  aspects  of  each  and  suggestions  for  improvement, 
(a)  LEP  bridging  manual,  (b)  Work  Journal  manual,  (c)  IE  Tea¬ 
cher's  Guide,  (d)  Other. 

5.  Comment  and  give  examples  of  how  the  ideas  of  others  affected 
your  planning  (PhS,  other  Instructors,  students,  etc.). 

6.  What  was  your  typical  final  product  in  preparing  for  ar.  IE 
class?,  e.g,,  list  of  goals,  by-the-uinute  plans,  list  of  bridg¬ 
ing  ideas,  teaching  strategies. 

7.  Other  comments  about  preparing  for  IE  classes. 

B.  Preparing  for  MS  classes. 

5.  Describe  how  you  planned  for  the  MS  classes  and  how  it  differed  , 
from  IE  class  preparations.  Include  comparisons  of  preparation 
time. 

9.  Did  you  discover  any  ways  to  relate  IE  task  experience  cognitive 
principles  to  the  MS  content?  Please  give  examples. 


C.  Conducting  IE  Classes 


10.  First,  give  the  overall  structure  of  your  own  approach  to  con¬ 
ducting  your  IE  classes,  etc.  That  is,  how  did  you  conduct  a 
typical  class? 

11.  Describe  the  approach  you  took  to  going  over  IE  homework  pages  in 
class  -  the  amount  of  time  spent,  how  you  mediated  homework, 
ate. 

12.  Same  as  10,  but  do  for  Work  Journal  homework. 

13.  To  what  extent  did  you  have  the  time  to  do  the  following  in 

class? 

a.  Mediate  students  in-class  performance  on  IE  pages. 

b.  Answer  student  questions. 

c.  Allow  free-flowing  student  discussion  and  questions. 

d.  Model  effective  thinking  yourself,  such  as  by  showing  how  to 
hypothesize,  etc. 

e.  Stop  to  use  standard  references,  define  vocabulary,  etc. 

f.  Use  your. own  questions  to  encourage  student  thinking. 

g.  State  or  list  cognitive  goals  or  functions  relevant  to  that 
class. 

h.  Summarize  what  went  on  in  class. 

14.  What  were  your  most  effective  teaching  strategies? 


D.  Bridging  in  IE  Classes 

15.  Did  you  have  much  time  to  do  bridging  in  class?  About  how  cany 
bridges  were  made  per  hour? 

16.  What  kinds  of  topics  did  you  typically  bridge  to:  MS,  other 
subjects,  personal  life,  etc.?  Did  the  bridglDg  topics  tend  to 
change  over  the  course  of  the  semester? 

17.  Did  you  tend  to  use  the  suggested  bridges  in  the  manual  or  your 
own? 


18.  To  what  extent  did  your  students  begin  to  make  bridges  on  their 
own?  Were  there  many  students  who  could  develop  good  bridges,  or 
just  •  few? 

19.  Clve  examples  of  some  oi  the  better  bridges  that  were  developed 
in  or  out  of  class.  You  can  list  your  own  and/or  those  of  oth¬ 
ers. 

E,  Conducting  HS  Classes 

20.  Describe  your  general  approach  towards  teaching  your  HS  classes. 
How  did  it  differ  from  that  for  IE  classes? 

21.  Did  your  experience  In  teaching  IE  classes  affect  the  way  you 
taught  HS  classes? 

22.  How  did  you  handle  1E/HS  transitions  from  clsss  to  class?  List 
any  procedures  that  you  used. 

23.  Did  you  usually  bridge  to  cognitive  principles  or  IE  activities 
during  the  HS  class  periods?  About  how  many  such  bridges  per 
hour  were  you  able  to  fit  in? 

F,  Student  Response/Effects 

24.  Did  most  students  seem  to  think  the  LEP  program  was  valuable? 

Were  there  exceptions?  Vhat  were  the  approximate  proportions  of 
students  having  a  favorable/unfavorable  opinion? 

25.  V'hat  reasons  did  students  give  in  complimenting  or  criticicing 
the  program? 

26.  Did  you  note  any  ’’critical  Incidents”  that  indicated  important 
effects  on  the  atudents?  For  example,  students  being  able  to 
express  themselves  better  or  breakthroughs  in  insight,  or  in¬ 
creases  in  the  motivation  of  some  students? 

27.  Was  there  evidence  that  the  students  applied  the  LEP  training 
outside  of  the  classroom?  For  example,  in  leadership  lab,  other 
courses,  etc.? 

28.  Did  you  note  any  other  Important  changes  in  student  behaviors  or 
abilities? 

29.  Were  the  noted  changes  in  students  true  for  many  students  or  just 
a  few? 

30.  Other  comments  on  the  effects  of  the  students  or  their  opinions 
on  the  program. 
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G.  Homework 


IE 

31.  Did  the  students  put  good  effort  Into  their  IE  homework  pages? 
What  proportion  did  not? 

32.  Did  the  students  ever  work  in  teams  and  mediate  each  other? 

33.  Did  the  students  do  "extra"  pages  on  their  own? 

34.  Do  you  think  these  homework  assignments  were  useful?  Did  It  help 
you  learn  about  your  students? 

35.  Give  examples  of  student  criticisms  and  compliments  about  the 
homework. 

Work  Journal 


36.  How  did  the  quality  of  the  work  journal  assignments  change  over 
the  semester? 

37.  What  did  students  seem  to  think  about  the  Work  Journal  program? 

36.  Do  you  think  the  students  saw  any  value  Id  the  assignments  in 
terms  of  developing  thinking  skills  or  was  it  just  a  "composi¬ 
tion"  exercise  to  thee? 

39.  What  value  do  you  see  in  the  Work  Journal  program?  Does  it  af¬ 
fect  thinking  skills  as  well  as  communication  skills?  Does  it 
diagnose  student  abilities  and  attitudes? 

40.  What  method  did  you  use  to  evaluate  the  students'  entries  and 
provide  feedback? 

41.  Please  make  other  comments  on  the  journal  program. 

H.  Instructor  Development 

42.  Please  comment  on  whether  teaching  in  the  LEF  program  has  aided 
your  personal  development. 

43.  Has  It  affected  the  way  you  interact  with  students?  Do  you  think 
it  will  affect  the  way  you  deal  with  others  in  other  assign¬ 
ments? 

44.  Has  it  affected  your  insight  into  your  own  thinking?  Are  there 
other  effects? 
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I.  General 


45.  Which  IE  instrument*  seemed  more  successful  end  which  seemed  less 
successful? 

46.  Did  any  of  the  components  of  the  LEP  program,  IE  exercises,  Work 
Journal,  discussion,  etc.,  help  you  In  evaluating  the  leadership 
skills  of  your  students? 

47.  Please  make  any  final  comments  either  by  describing  your  experi¬ 
ence  or  making  suggested  changes.  Include  any  techniques  that 
you  found  successful  in  solving  problems  or  making  the  program 
work  better. 
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APPENDIX  G 


LEP  Student  Questionnaire 


This  questionnaire  was  given  to  all  the  students  in  the  LEP  who  took 
part  in  the  LEP  training  (not  control  schools).  It  has  both  open-ended 
and  fixed  response  nodes. 
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LEP  STUDENT  QUESTIONNAIRE 


SCHOOL  _  KS  I  SECTIOH _ _ 

(If  you  are  cross  enrolled,  put  your  own  school.) 

We  are  asking  you  to  fill  out  this  questionnaire  so  we  can  improve  the 
LEP  program.  As  you  know  there  are  two  main  parts  to  the  program:  (1)  in¬ 
strumental  enrichment  training  and  (2)  work  Journal  writings.  Your  comments 
will  be  kept  private  and  you  should  not  put  your  name  or  social  security 
number  on  this  questionnaire.  Therefore  no  one  will  know  who  made  the  posi¬ 
tive  or  negative  comments  on  the  program.  Just  put  your  school  name  and  your 
class  section  at  the  top  of  this  form. 

The  questionnaire  is  split  into  two  sections.  Section  A  contains  3  ques¬ 
tions  that  require  you  to  write  out  your  answer.  In  section  B,  however,  you 
Just  put  an  x  to  give  an  answer.  There  are  more  instructions  on  section  B 
.next  page. 


SECTION  A 

1.  Do  you  think  the  LEP  program  helped  you  in  any  way?  If  it  did  help  you, 

•  give  some  examples.  If  it  did  not,  please  say  so  and  comment  on  your  ex¬ 
perience. 


2.  Please  comment  on  what  you  liked  about  the  LEP  program  and  what  you  did 
not  like. 


3.  Did  both  the  instrumental  enrichment  training  and  the  work  Journal  pro¬ 
gram  training  help  you  or  did  one  help  you  more  than  the  other?  Please 
explain  your  answer.  If  either  or  both  of  them  did  not  help  you,  please 

aay  ao. 
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SECTION  B 


7 


Now  we  wish  you  to  show,  the  ways  that  the  LEP  training  helped  you. 

Below,  you  will  find  s  list  of  abilities  that  the  LEP  training  nay  have 
helped. 

Read  each  ability  and  show  whether  you  thought  that  the  LEP  training 
improved  that  particular  ability.  If  LEP  helped  you  a  lot  put  an  x  in  column 
3.  If  it  only  helped  a  little,  put  an  x  In  coluon  2.  And  if  LEP  did  not  help 
at  all,  put  an  x  in  coluon  1. 

The  first  line  is  an  example.  The  ability  Is  "understanding  basket¬ 
ball",  I  don't  think  LEP  helped  oe  understand* basketball  so  I  put  an  x  In  the 
"did  not  help  oe"  column. 

Please  put  an  x  along  side  the  remaining  abilities  to  show  the  abilities 
that  LEP  did  not  help,  helped  a  little  bit,  or  helped  a  lot, 
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Abilty  to  understand  basketball  (EXAMPLE  ONLY) 

1.  Ability  to  analylze  problems 

2.  Ability  to  be  precise  and  reduce  errors 

3.  Ability  to  discover  solutions  to  problems 
Ability  to  learn  Military  Science  subjects 

5.  Ability  to  learn  other  college  subjects 

6.  Ability  to  conduct  yourself  with  self-confidence 

7.  Ability  to  give  and  understand  instructions 
6.  Abilty  to  be  a  leader 

9.  Ability  to  express  ideas  by  writing 
70.  Ability  to  express  Ideas  through  speaking 

11.  Abilty  to  think  about  the  way  you  think 

12.  Ability  to  take  time  to  think  things  out 


(1) 

(2) 

(3) 

LEP 

LEP 

LEP 

Did  not 

Helped  a 

Helped  me 

help  me 

little  bit 

a  lot 

__ 

— 

— — 

-L— 

— 

— 

— 

— 

— 

— 

— — 

■  ■ 

1  ■' 

'  1 

— 

— 

— — 

— 

'  .  - 

— 

— 

— 

— 

- 
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— 
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